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COMPUTER COMMUNICATION 
FIELD OF INVENTION 

The present invention relates generally to electronic devices that co mmuni cate among 
themselves using acoustic transmissions, especially using communication channels designed 
5 for communicating wi th humans. 

BACKGROUND OF THE INVENTION 
Computer network components that communicate using RF radiation, wires or JR 
radiation arc well known. In addition, some home appliances are controlled using an ultrasonic 
remote control. Also known are smart cards that use an ultrasonic acoustic link. 
10 However, such dedicated cOTnrnunication mechanisms require that the computer 

network components have installed thereon specialized communication hardware. Installing 
such hardware on an existing computer may he expensive and/or problematic. Further, some 
electronic and/or computer embedded devices, for example cellular telephones may be 
"sealed" products, to which it is impossible to add internal components. 
15 PCT publications WO96710880, W094/17498, WO93/21720 and W093/11619, the 

disclosures of which arc incorporated herein by reference describe an electronic device which 
transmits coded information to a microphone of a telephone using a DTMF-fike encoding 
scheme. A WWW page addressed "httpry/www.Gncotone.com/h^ suggests 
nfiiTig such a device to transmit audible DTMF-like tones to a personal computer using the 
20 computer's sound card. 
C3 Two way communication using audible DTMF-like tones, between a smart card and a 

r« telephone communication system is described in US patent 5,583,933, the disclosure of which 

is incorporated herein by reference. 

SUMMARY OF THE INVENTION 
25 One object of some preferred embodiments of the invention is to simplify interaction 

between electronic devices by removing a common requirement of installing dedicated 
communi cati on hardware on the devices. Some suitable electronic devices include: computers, 
televisions, watches, PDAs, organizers, cl<x*ronic toys, electronic games, voice-responsive 
appliances, wireless communication devices, answering machines and desktop telephones. As 
30 used herein the term "electronic device" is used to encompass a broad range of electronics- 
including devices. In some of the embodiments described below, a particular type of electronic 
device is singled out, for example a computer or a toy, as some of the below-described 
embodiments are more useful for some types of electronic devices, than for other types of 
electronic devices. 



v:* 
JO 



1 



CTOg] 



0D * HaiSN&I 



cecsxze c ziq xvd eo'jz ohm 66. co/co 



100/00809 

An object of some preferred embodiments of the invention is allowing electronic 
devices to communicate using an input and/or output channel, preferably an acoustic channel, 
but possibly a visual channel, which was designed for communication with Vrnman users and 
not for communication with electronic devices. In other cases* the communicatioTi channel is 
5 not originally intended for communication with outside components at all. for example, a 
diskette drive. 

An object of some preferred embodiments of the invention is to allow a. szeart card tor 
be read by and written to using standard computer hardware without requiring an 'installation? 
of specialized hardware. This is especially useful for electronic wallets and Internet commerce, 
10 wbere the cost of installing dedicated hardware may prevent wide acceptance of these 
commercial methods. Additionally, using a smart card can provide methods of solving the 
security and accountability issues entailed in electronic commerce 

An aspect of some preferred embodiments of the invention relates to comnDtunicatrng 
with a computer using a sound card installed on the computer. In a preferred embodiment of 
h* 15 the invention, a device, preferably a smart card, transmits information to the sound card's 
p; j microphone and receives information form the computer using the sound card's loudspeaker, 

CH Preferably, the transmission uses non-audible acoustic frequencies, for example ultrasonic or 

!lj imxasonic frequencies. It should be noted that standard music cards are designed for music 

= generation, however, they have a limited reception and transniission ability in the near- 

20 ultrasonic frequency ranges. 

Ultrasonic cx>m muni cation has several advantages over audio r ^vmrmin ic^'rinn* 

(a) smaller transducers can be used; 

(b) transmission is more efficient; 

(c) lower noise levels are typical; 
25 (d) resonant frequencies have wavelengths on the order of a size of a credit card can be 

used; and 

(e) higher data rates can be achieved. 

In a preferred embodiment of the invention, the ultrasonic frequencies used are low 
ultrasonic frequencies for example between 18 kHz and 24 KHz, more preferably between 20 
30 kHz and 24kHz, and in some preferred embodiments about 23lrWfa. Often, these frequencies 
can be transmitted and/or received using standard audio components. For this reason, lower 
frequencies may be preferred over higher frequencies, even though the lower frequencies 
typically afford a lower data rate and are more easily disrupted. These particular frequencies 
are suggested because they match industry standards for sampling in audio cards (e.g., 
35 "SoundBlaster"). If other sampling frequencies arc available, the preferred frequency may 
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adjusted accordingly. Preferably, a minimum frequency used is selected so that it is inaudible 
to a human. In some cases, the frequency selection may depend on the age of me human. 

A benefit of ultrasound over RF transmission is that the range of the ultrasonic 
transmission can easily be controlled by varying its amplitude. Typically, ultrasonic 
5 transmissions do not pass through walls, potentially providing increased security by limiting 
eavesdropping and inference from outside the room. In addition, ultrasonic transmission 
usually do not interfere with the operation of electronic equipment, even when used at a high 
power setting. Thus, tdtrasoni^ cxjiminvinicaticm is better smted for people with pacemakers and 
for hospital settings. Another advantage of acoustic transmission is a reduced perceived and 
10 actual health danger to the user. 

An aspect of some preferred embodiments of the invention relates to communication 
between electronic devices using acoustics. Alternatively or additionally to electronic devices 
communicating using RF; varying magnetic fields; IR; and visible light, electronic devices 
may communicate using acoustics, in accordance with preferred embodiments of the 
15 invention. In some cases, one communication direction is acoustic and the other is non- 
acoustic, for example RF or IR, for example when mmTmrmVa^g with a set-top box in 
Cfi accordance with a preferred embodiment of the invention (one way acoustic from the TV and 

the other way IR, the same as an IR remote control). In a preferred embodiment of the 
i invention, the acoustic waves used for communications are incorporated in sounds used for 

R 20 regular operation of the device, for example by modulating beeps. Alternatively or 
O additionally, the sounds are inaudible, for example being ultrasonic, irifrasorric, of a low 

Uj amplitude and/or causing only small changes in amplitude and/or frequency. 

Mil 

if| It is noted that many electronic devices include a microphone and/or a speaker. In a 

preferred embodiment of the invention, the microphone and/or speaker are used to 
25 communicate with the device. In one example, an acoustic smart card (or an "electronic 
wallet" card) communicates with such a device using sound and/or ultrasound. Such a smart 
card may transmit information stored thereon. Possibly, the mfbrmation is encrypted, for 
example, using RS A encryption. 

In a preferred embodiment of the invention, a smart card may bo "swiped" at 
30 practically any existing computer and many existing electronic devices, possibly requiring a 
simple software installation,, but no hardware installation (assuming some acoustic hardware 
exists). Such simple swiping should ease acceptance of the card by Internet browsing home 
shoppers. In some ca&es, the swiping software may be downloaded as a Java Applet. 

Alternatively or additionally, two electronic devices can communicate. For example a 
35 cellular telephone and a PDA, each of which includes a microphone and a speaker can 
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communicate. Another example is programming a cellular telephone with names and numbers 
stored in a PDA or for the cellular phone to interrogate the PDA regarding a particular 
telephone number. Alternatively or additionally, a network may be formed of a plurality of 
such devices, possibly, with one device forwarding messages from a first device to a second 
device. Alternatively or additionally, peripherals may be connected to a computer using an 
acoustic connection, without requiring wiring or special hardware. In some embodiments, a 
single acoustic transducer (microphone or 3peaker) may be controllable to act as both a 
receiver and a transmitter^ by suitably programming the electronic device. 

Many computers are sold with a Sound-Blaster Compatible sound subsystem, stereo 
speakers and a microphone. Some computers are provided with other types of sound systems, 
which types also supjxut the application of preferred embodiments of the invention, possibly 
with a variation in frequencies to account for different circuit or sampling characteristics. 
Typically, this sound system is designed for generating music and other audible sounds. In 
addition, many computers include an internal speaker and a modem speaker. Some computers 
H 15 use USB speakers which arc connected directly to the USB. 

It should be appreciated that in some embodiments of the invention the sound 
cornmunication is directed at the device for its use, control and/or processing and is not meant 
for mere passing through the device. For example, a telephone may interpret computer- 
information encoding signals, rather than transmitting them on through the telephone network, 
20 as in the art. In a preferred embodiment of the mvenxion, a wireless telephone is realized using 
4 ultrasonic cornmunication between a base station and the hand set. In a preferred embodiment 

of the invention, the base station is embodied in a computer, which communicates with the 
telephone. Possibly, the wireless conmrunicatian uses the same loudspeaker and/ox 
microphone as used for communication with a person using the telephone and the computer. 
25 Additionally or alternatively, the handset is used for Internet telephony, via the computer. 

An aspect of some preferred embodiments of the invention relates to interfacing a toy 
and/or other devices with a computer system without installing hardware on the computer. In 
one example, the loudspeakers, already installed on a computer, are used to interrogate an 
identification device, using ultrasound. In another example, such interrogation is used to 
30 determine distance from- and/or location of- a toy. Preferably, the computer's microphone is 
used to detect a response firom the inte r rog a ted device. In some embodiments, especially for 
toys, the interrogation may comprise audible sounds. Thus, in a preferred embodiment of the 
invention, cheap and/or simp le cornmunication between a toy and another toy or a computer is 
feasible, since no special computer hardware is required. In addition, it becomes simpler to 
35 connect a play implement to a computer game that responds to thai play implement. 
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Additionally or alternatively, ultrasonic communications may be used to download a program 
and or music file to a toy. Possibly, the program and/or music file are directly downloaded 
from an Internet as sound files, possibly obviating the need for a dedicated toy (or device) 
programming software interface. Possibly, the toy and/or device generate sounds in response 

5 which sounds are transmitted back through the Internet. 

In a preferred embodiment of the invention, the acoustic waves used for 

^ communication or possibly, dedicated acoustic waves, may be used to determine the relative 
position and/or orientation of electronic devices. In a preferred embodiment of the invention, a 
touch screen is emulated by interrogating a transponder on a pointing implement, using built- 

10 in speakers of an electronic device, to detect to position, orientation and/or motion of the 
implement In a preferred embodiment of the invention, the transponder is embodied using a 
speaker and a microphone of the pointing implement, for example if the implement is a 
cellular telephone. 

f 3 F°r example, one or more of the following sound generators may be available in a 

^ 15 personal computer: built-in speaker, modem speaker and sounds generated by mechanical 
ru devices, such as a hard disk drive or a diskette drive. These sound generators may also be used 

^ for transmitting information. 

An aspect of some preferred embodiments of the invention relates to inactivating a 

£ stolen electronic device. In a preferred embodiment of the invention, the electronic device 

C3 

s j 20 interrogates an acoustic transponder using the device's built-in speaker and/or microphone. If 
Q die transponder does not respond (e.g., the device was stolen and separated from the 

transponder), the device does not work If possible, the device transmits a message to an 
4) enforcement authority or to the owner, for example by computer network (e.g., for a laptop 

computer) or by wireless communication (e.g., for a cellular telephone). A particular type of 
25 stolen property is copyrighted software, which can be programmed to interrogate a transponder 
which is nearby, e.g., attached to a case of the software and/or the computer. An illegal copy of 
the software will have no available transponder to respond to an interrogation, thereby 
identifying itself as stolen. Optionally, the program them communicates with the copyright 
owner. 

30 An aspect of some preferred embodiments of the invention relates to authorization and 

authentication over an Internet or another type of communication network, using sound. 
Preferably, the normal communication pathway is not changed, except that the two ends of the 
pathway may require hardware or software for manipulating sound signals. In one example, a 
smart-card transmits an encoded acoustic signal to a computer. That signal is transmitted over 

35 the Internet to a remote server computer, to serve as authorization for debiting an account In 
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another example, in which information is transmitted in the opposite direction, a coded signal 
may be provided from a toy program depository, to be downloaded using acoustic waves to a 
toy that is near the computer. Such a coded signal may also be used to download information 
to a smart card. 

An aspect of tsome preferred embodiments of the invention relates to transmission of 
power to a smart card. Preferably, the received power is stored to be used for transmission 
and/or processing. In a preferred embodiment of the invention, the'pc^Ver is Stored for short 
periods of time, for example several seconds. AltematiVeiy, at Jb&st £oine of the power is 
stored for longer periods of time, for example minutes or hours. In a preferred embodiment of 
the invention, the power is transmitted using an acoustic wave, preferably an ultrasonic wave, 
possibly the same wave as used for communication. Generally however, the power wave is 
transmitted for a considerably longer duration than an information wave. Additionally or 
alternatively, power is transmitted using optical energy which is received by photoelectric cells 
on the smart card. In one example, a smart card is placed near a display to receive energy from 
^ 15 the display. Possibly, the energy is modulated, spatially or temporally, to transmit information 
i|j to * c smart card, in addition to transmitting power. Alternatively or additionally, the card may 

CH receive (and store) power radiated by the screen control circuitry as electromagnetic signals. 

l j An aspect of some preferred embodiments of the invention relates to smart card 

construction. In a preferred embodiment of the invention, the entire card is formed of a 
20 piezoelectric material and the frequencies transmitted and/or received by the smart card are a 
3 function of the acoustic characteristics of the card. Additionally or alternatively, only a portion 

: iy of the card is electrified for transmission and/or reception, for example, only a magnetic strip 

J of an image pasted thereon. Additionally or alternatively, only a portion of the card is 

polarized during manufacture, to possess a required piezoelectric effect. 
25 An aspect of some preferred embodiments of the invention relates to using a computer 

microphone to acquire ambient sounds, then analyzing these sounds using a computer, and 
then using the analysis to determine events occurring in its neighborhood. In a preferred 
embodiment of the invention, electronic devices are designed and/or progr ammed to generate 
sounds (possibly in the ultrasonic range), which sounds represent their current state or 
30 particular events. Thus, by eavesdropping on these sounds it is possible to determine the status 
of electronic devices. In one example, a malfunctioning fax machine will generate one hum 
and/or an arriving fax on an operating fax machine will generate a different hum or sound 
pattern. A computer near the fax machine can determine the status and events and transmit mis 
information, possibly using a computer network, to a user of the information. In some cases, 
35 the existing sounds generated by a fax (beeping, printing noises etc.) can be identified by the 
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computer, without need for special programming of the fax machine to generate novel sounds. 

An aspect of some preferred embodiments of the invention relates to mterrogaring an 
electronic device using an acoustic channel. Such interrogation should not adversely affect the 
operation of the devices. In one example, the device is a network component, such as a hub. In 
5 another example, the device is a computer. In a preferred embodiment of the mvention, the 
acoustic channel is controlled by the computer (analysis of mcoming information, generation 
of outgoing transmissions , and possibly execution of certain software) without interfering with 
the work of a person using llhsit computer, for example word processing work. 

An aspect of some preferred embodiments of the mvention relates to using a smart card 
10 to conduct business transactions, especially at restaurants. In a preferred embodiment of the 
invention, an acoustic smart card is used to perform one or more of receiving a menu, 
ordering, getting the attention of a waiter, adding up a bill, allowing a user to add a tip and 
settling a bill Such, a smart card may communication directly with a central computer at the 
;Lj restaurant. Alternatively, the smart card communicates using strategically placed loudspeakers 

M 15 and microphones in the restaurant, for example placed at each table. Possibly the smart card 
communicates with a computer or a PDA used by the waiter. In a preferred embodiment of the 
invention, the smart card negotiates bandwidth requirements with other smart cards in the 
restaurant, so that they do not interfere with each other. 

BRIEF DESCRIPTION OF THE DRAWINGS 
O 20 The invention will be more clearly understood with reference to the following detailed 

descriptions of non-limiting preferred embodiment of the invention in which: 

Fig. 1 is a schematic illustration of a computer and an electronic device which are 
operative to communicate using sound waves, in accordance with a preferred embodiment of 
the invention; 

25 Fig- 2 is a schematic illustration of two communicating electronic devices, in 

accordance with a preferred embodiment of the invention; 

Fig. 3A is a schematic illustration of a smart card cemmtmicating with a computer, in 
accordance with a preferred embodiment of the invention; 

Figs. 3B-3D are schematic illustrations of smart card construction in accordance with 
30 preferred embodiments of the invention; 

Fig. 3E is a schematic illustration of a smart-card reader in accordance with a preferred 
embodiment of the invention; 

Fig. 4A is a schematic illustration of an Internet transmission pathway for sounds, in 
accordance with a preferred embodiment of the invention; 



fi! 



m 



if 



CBCSI Z g C Z LB YVJ Zl'lZ Q3M gg> CO/CO 



100/00809 

Fig. 4B is a schematic illustration of usage of a smart card in a restaurant setting, in 
accordance with a preferred embodiment of the invention; 

Fig. 5 is a schematic illustration of a method of tapping into a computer, without 
requiring complicated installation of hardware, in accordance with a preferred embodiment of 
5 the invention; 

Fig. 6 is a schematic illustration of an unobtrusive computer checkup in accordance 
with a preferred embodiment of the invention; 

Fig. 7 is a schematic illustration of a computer communication setup using acoustics, m 
accordance with a preferred embodiment of the invention; and 
10 Figs. 8A and 8B comprise an electronic schematic of an ultrasonic circuit in 

accordance with a preferred embodiment of the invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
Fig. 1 is a schematic illustration of a computer 20 and an electronic device 30, which 
are operative to communicate using sound waves, in accordance with a preferred embodiment 
M 1$ of the invention. Most computers currently on sale include a sound system 24, usually a sound 
t7j card, connected to at least one microphone 26 and at least one speaker 28. Many electronic 

ffl devices include a microphone 34 and a speaker 36. In a preferred embodiment of the 

mvention, computer 20 and electronic device 30 communicate using these standard 
« components, which are usually not designed for computer c^nnmunication but for human 

20 cornmunication. In some cases, the electronic device (or the computer) may include a jack to 
□ which one or more speakers and one or more microphones may be connected. Preferably, such 

connected acoustic elements are positioned on a hard to obstruct portion of the device, 
preferably at positions where they have a wide field of view. 

In one preferred embodiment of the invention, a standard card, such as the popular 
25 "Sound-Blaster" is used to generate sonic and/or ultrasonic signals to (and receive from) an 
electronic device, a toy and/or another object. The acoustic signal may be audible or inaudible, 
for example being ultrasonic or in&asonic. Preferably, frequencies of about 20kHz, 22kHz and 
24kHz are used, since a standard sound card provides these sampling rates (and/or their 
multiples, eg., 48kHz). 

30 In some preferred embodiments of the invention, a sound card is adapted to work in the 

near ultrasonic range, for example by increasing its asmipitrig frequency. Generally, the 
microphone and loudspeaker used for a computer system can support low frequency 
ultrasound with a sufficient fidelity. In some cases however,, a special ultrasound-sensitive 
microphone or ultrasound -effective speaker may be used. In other cases, the sensitivity of a 
35 particular microphone and/or loudspeaker maybe detennined by the user prior to or during 

8 



h 



0Z0| 8 00 IBXSNHd C8C9TZ6 C ZIS XVJ ZX^XZ (QUI 66. CO/Co" 



« 



100/00809 

communication with an electronic device. In one example, if a device having known 
characteristics transmits an equally powerful signal at several frequencies, the frequency 
sensitivity (and/or directional sensitively) of a micropnone may be determined. In a similar 
manner, a computer may generate these sounds and the signals detected by the device analyzed 
5 to determine output characteristics of the particular loudspeaker used. In addition, a self- 
calibration procedure may be performed by listening to the computer's output using the 
computer's microphone. In some cases, both the device and the computer sound systems can 
be calibrated by combining self testing and cross-testing. ^ jl-l * „ > ^ 

In some cases, the microphone and/or the sound card are sensitive enough to receive, 
10 from the object, an RF signal associated with generating the acoustic signals, even if an 
acoustic signal is not .sent (eg., no loudspeaker is present). 

In a preferred embodiment of the invention, such an acoustic communication may be 
m used to program a toy and/or retrieve information from a toy, for example replacing anRP linlr 

p for this purpose as described in US patent number 5,752,880, the disclosure of which is 

py 1^ incorporated herein by reference. la a particular embodiment, music may be downloaded from 
the Internet, directly to the toy, for example by modulating an ultrasonic signal to cany MP3 
Iq sound files. Alternatively or additionally, such a link may be used for real-time communication 

'' •4 with the toy. 

f=l Some embodiments of the invention do not require that the electronic device 

UJ 20 communicate with a computer. Fig. 2 is a schematic inustration of two communicating 
electronic devices 30 and 30*. In one example, a PDA communicates with a printer. In another, 
an organizer communicates with a satellite telephone. Possibly, such communication is used to 
exchange data files and/or to share capabilities, such as modem connections. In some cases a 
port adapter may be required to be plugged into a port, for example a somc-to-parallel adapter, 
25 which converts between acoustic signals and parallel port signals, 

A computer network in accordance with a preferred embodiment of the invention 
utilizes sound waves transmitted between computers for communication, vicing existing 
hardware, such, as an audio card, loudspeakers and a microphone. Preferably, the sound waves 
are ultrasound waves. In a preferred embodiment of the invention, such a computer network is 
30 used to connect a PDA or a portable computer to a different computer, for example for data 
transfer or for sharing peripherals, such as a modem, a printer or a storage device. Thus, an 
existing PDA (which includes a loudspeaker and a rrricrophone) can use a modem of a desk- 
top computer, without requiring additional hardware in the PDA, possibly requiring only a 
small software change. In another example an acoustic-enabled smart-card (such, as that 
35 described, below), can print, or backup information using a standard desktop computer. 
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Alternatively or additionally, such a network may be used in a small office, for example for 
file or printer sharing. 

In a preferred embodiment of the invention, a standard corrnnunication 
protocol/language is defined, so that many types of devices can cornrnunicatc and/or share 
5 resources using the standard language. 

In a preferred embodiment of the invention, sonic and/or ultrasonic communication is 
used for paying a toll or a fee (human, package or vehicle), utilizing a reactive component, 
possibly a pass&ro transponder;- on -the- fctfilsd item. In another example, such communication is 
used to pay a transportation fee, for example on a subway or a bus. Alternatively or 
10 additionally, an acoustic mechanism as described herein is used to open vehicle barriers, for 
example at entrances to apartment complexes or to open garage doors. Alternatively or 
additionally, the acoustic mechanism is used for automatic refueling/bi lltng systems, possibly 
transmitting billing and/or mileage information to a pump receiver, controlling the fuel flow 
Q and/or verifying the fuel type. Possibly, a car dashboard speaker, a car horn, an alarm speaker, 

15 a car radio speaker or a dedicated speaker, is used to sound the required sonic and/or ultrasonic 
signals. In a preferred embodiment of the invention, a car radio speaker is made to generate the 
required sounds by transmitting an electromagnetic wave to the radio or to its loudspeaker, 
from a specialized electronic device. 

Alternatively or additionally, to using a computer, in a preferred embodiment of the 
20 invention, a set-top box is used to transmit and/or receive acoustic signals. Preferably, a 
O microphone is connected to the set-top box. Alternatively or additionally, the transmission 

7f* back to the set-top box uses an IR signal, which is detectable by the set-top box. In one 

Ul example, the set-top box includes software that analyzes signals. Such signals may comprise 

responses of electronic devices and/or toys to sounds generated by the television or by the set- 
25 top box. Alternatively or additionally, the set-top box adds sounds (or ultrasonic waves) to a 
video and/or audio stream decompressed by the set-top box- Alternatively or additionally, the 
set-top box adds temporal and/or spatial optical modulations to a video stream, for an 
cptically-scnsitrvc electronic device to detect. 

In a pre fer r ed embodiment of the invention, the detection of a signal by an electronic 
30 device (or a computer) comprises a binary detection of the signal, e.g., an on/off state. 
Additionally or alternatively, more complex signal detection and analysis techniques may be 
implemented, for example, detection of signal amplitude, frequency, frequency spectrum, 
Doppler shift, change in amplitude and/or duration, detection of a number of repetitions, voice 
and/or other pattern recognition fn the sound. Various information encoding protocols may be 
35 used, including AM, FM, PSK, QPSK and pulse length encoding. The transmitted signal may 
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include one or more of information about the sending device's activities, location, 
environment, nearby devices, locally sensed information, logic state, readiness, requests for 
information and/or answers to such requests* 

Such signal detection and/or analysis may also be performed on a computer that is in 
5 communication with the electronic device. The physical detection circuit is preferably located 
on the toy. Additionally or alternatively, the detection circuit is also located on the computer. 

In a preferred embodiment of the invention, microphone 34 (or microphone 26) 
~ essnprises a direction?! microphone, for example a stereophonic microphone or a microphone 
in which the frequency response is spatially non-uniform. 
10 PCT application PCT/IL98/00450, tided "The Control of Toys and Devices by 

Sounds", filed September 16, 1998. in the Israeli receiving office, the disclosure of which is 
incorporated herein by reference, describes sound actuated toys. In particular, the application 
describes various sound makers that generate sounds inadvertently as a result of motion, for 
example beads in a box or noise form a crinkle material. Such a sound maker is connected to 
15 and/or mounted on a toy, so that when the toy moves a signal will be generated for another toy 
or device to acquire. This PCT application also describes detecting the direction and/or 
position of a sound, using directional microphones and/or a stereophonic microphone 
CQ including two or mora microphone elements. Additionally or alternatively, a relative distance 

£ " is determined based on amplitude of the sound. 

20 Israel application 127,569, filed December 14. 1998, titled "Interactive Toys' 1 , the 

disclosure of which is incorporated herein by reference, describes various toys and electronic 
Uj devices which interact using sound waves. These applications contain information useful in the 

design and use of acoustically controlled devices, and which may be applied towards some 
preferred embodiments of the invention. 
25 Fig. 3A is a schematic illustration of a smart card 40 that communicates with a 

computer. Although a smart card is a special case of an electronic device, it is noted that 
typical smart cards do not include an acoustic input/output channel, especially not an 
ultrasonic one. 

Tn a preferred embodiment of the invention, suuuul card 40 comprises an acoustic 
30 element 42, a processor 44 that controls the acoustic element and a memory 46 for storing 
information. Such a smart card may use a single piezoelectric transducer (possibly a film 
layer) for both transmission and reception. 

In a preferred embodiment of the invention, the received signals from dement 42 arc 
amplified to TTL levels and connected directly into one or more data lines of the micro* 
35 controller. This "data" may be treated as binary sampled input and analyzed to determine 
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characteristics of the received signals, for example using Fourier analysis. Thus, a high 
acoustic frequency can be detected and/or analyzed, without requiring a separate AID. 
Preferably, the signal is amplified by various amounts, such as by several multiples of two and 
amplified amount is connected in parallel to a different one of the data legs, so that multi-level 
s signal detection is facilitated. Alternatively or additionally, one or more data lines may be 
directly (Le., no D/A, put possibly an amplifier or an isolator) coupled to a loudspeaker, to 
generate an output acoustic signaL *~ 

As many electronic devices include a speaker and/or a mi cropbo.^ -s uch a sard may 
communicate with any such device that has suitable software. Due to the decreasing size of 
10 electronics, in some cases, a smart card may be emulated using a PDA (or vice-versa), with 
regard to both size and functionality. Additionally or alternatively, such smart card 
functionality may be exhibited by a cellular telephone or a lap top computer. A benefit of a lap 
l\\ top computer and of a PDA is their convenient user-interlace. A benefit of a cellular telephone 

™ is the possibility of real-time and/or off-line communication with a central location, 

fjj IS In a preferred embodiment of the invention, the smart-card includes a battery, for 

example a lithium ion battery for providing power to transmit, receive and/or process acoustic 



ru 



&8 



fQ signals. Possibly, the battery is rechargeable. Additionally or alternatively, the smart-card is 

X " light-powered. Additionally or alternatively, the smart-card includes a battery which is charged 

lj by optical wavelength energy, for example using a photoelectric cell on the smart-card In a 

jAj 20 preferred embodiment of the invention, the card is recharged by placing it against a cornpxxter 
y screen or a TV screen that is lit up. Preferably, the illumination of the screen is modified, 

\T) spatially and/or temporally, to transmit information to die card. The modification of the 

illumination may be by a computer or by a set-top box. Transmission back to the computer 
and/or set-top box: may be achieved using other methods described in mis application, 
25 Additionally or alternatively, power to activate the smart card and/or to recharge its 

power cell may be provided from via speaker. Preferably, the power is provided as an 
ultrasonic wave, possibly, but not necessarily, the same wave used to transmit information to 
the card. In this and other embodiments of a smart card, a single circuit is optionally used to 
receive both power and transmissions. Possibly, at least part of the same circuit is also used to 
30 transmit signals. Although the power levels are generally low, the duration of transmission of 
power can be made relatively longer (minutes, hours) than the duration of the power usage 
(micro seconds* milliseconds). 

Additionally or alternatively, the card may be recharged by plugging it into a PC-card 
slot, a USB plug or a different suitably-sized cornmumcation port. Preferably, once the card is 
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plugged-in it also transmits information using the communications port The card preferably 
includes a plurality of electrical contacts at one of its ends and/or a connector-sized end. 

Additionally or alternatively, the card may be inserted into a CD-ROM drive or a 
diskette drive and obtain power from the motion of a head and/or a spinner motor. Possibly, 
5 the power is generated by friction- Additionally or alternatively, the power is obtained from 
the read/write energies (laser, magnetic) used by the drive. Additionally or alternatively, the 
card interacts with the head, for example a diskette indS read head to communication with a 
host computer of the drive. Possibly, the card may tat-Sftist (for cammuric^iian purposes) with 
magnetic read and/or write heads even if the card is not inserted in the slot Preferably, the 
10 card includes magnetic-field sensitive sensors, such as GMR sensors. Alternatively or 
additionally, the card include an KF or magnetic filed generating unit capable of affecting the 
read/write heads. 

Additionally or alternatively, the card may be powered by incrtial power, for example 
form movements of a person carrying the card. Additionally or alternatively, the card may 
H 15 include a piezoelectric power converter, possibly utilizing a same piezoelectric element as 
used for communication, to convert flexing of the card or varying pressure on die card 
(typically inadvertently) into electrical energy. Possibly, the card can be energized from 
ambient vibrations, such as those caused by a computer, when the card is placed on the 
computer. 

20 Figs. 3B-3D are schematic illustrations of variations of smart-card structures, in 

accordance with preferred embodiments of the invention. In Fig. 3B*, substantially all of one 
side of the card forms an acoustic transducer. The processor and the memory (44 and 46) are 
preferably embedded in the card. The battery may be a thin battery which is embedded in the 
card or glued on it In one example, the card itself is manufactured of a piezoelectric material 
25 and area 42 indicates the region which is electrified using electrodes. In one embodiment, only 
two electrodes are used. In other embodiments, at least one of the electrodes comprises a 
plurality of electrodes, so that various acoustic modes may be excited and/or sensed in the 
card. Possibly, the two electrodes have a piezoelectric material sandwiched between them. 
Possibly the piezoelectric material is the card itself In a preferred embodiment of the 
30 invention, the card is formed of a polarized plastic with piezoelectric properties. Possibly, only 
the portion of the card adjacent the electrodes is polarized. In some embodiments of the 
inventi on a same Tegion 42 is used both for transmission and for reception, in others, separate 
regions are provided, which regions may overlap. 

In a preferred embodiment of the invention, the card is electrified with an array of 
35 electrodes and these arrays may be used to detect pressure on the card, for example pressure 

13 



a 



m 

m 



UJ 



CD * HHXSNHd 



C6CSTZ6 C ZZ.6 XVH tTiXZ <THtt S6 . CO/CO 



100/00809 

caused by moving alTtylus over the card. Depending on the processing power of the card, this 
may be used as a handwriting input. Alternatively or additionally, the piezoelectric regions 
may be used for power supply, as indicated above. Alternatively or additionally, the 
piezoelectric regions my be used to generate sounds, for example recording or synthesized 
5 speech or indicator (e.g., beeps) sounds. Alternatively or additionally, the piezoelectric regions 
may be used as a sonic microphone, for speech input. Alternatively or additionally, the 
piezoelectric regions may be used to detect data input of a simpler kind, fox example tapping, 
flexing, and/or bending or the card, or selective pressure on certain areas of the card. 

In a preferred embodiment of the invention, the size and shape of the region and/or the 
10 mechanical characteristics of the card material (or at least of area 42) are selected to 
acoustically match the desired transmission and/or reception characteristics of the smart card- 
As can be appreciated, in some cases it is the card size and mechanical characteristics which 
determine the ultr asoni c frequency to be used. Preferably, the size and thickness of the card are 
-ffl similar to that of a credit card. Possibly, card 40 is somewhat thicker than a credit card. 

P 15 In Fig. 3C a magnetic strip doubles as a resonator 42 for piezoelectric transaction, 

rtj In Fig. 3D a holograph glued onto the card (for example as in a VISA card) serves as 

* « the ultrasonic transducer and/or to cover or contain, the electronics of processor 44 and/or 

f'p memory 46. La the photoelectric embodiments, above, an area 43 of the card may be embedded 

^ with photo-electric cells. Possibly, a same area is used both for photoelectric activity and for 

f=* 20 piezoelectric activity. In a preferred embodiment of the invention* card 40 includes an infra-red 
generating area, for example a LED 41 or a surface patch. Optionally, card 40 includes a thin- 
screen type display (not shown), for example an LCD display, for displaying information 

*D stored, transmitted and/or received and/or feedback. 

if? 

Fig. 3E is a schematic illustration of a smart-card docking station 110 in accordance 
25 with a preferred embodiment of the invention. A smart card 1 12 is inserted into the reader 1 10. 
A portion 114 of the reader is configured to communicate with the smart card, for example 
using RF, magnetic fields, ultrasound, IR and/or any other communication protocols- Possibly, 
a plurality of such areas 114 are provided, each for a different physical protocol. These 
communications with the card are preferably transformed, using an acoustic transducer 116, 
30 into acoustic communications to be transmitted to- and/or received by- a remote computer or 
other electronic device, using the methods as described herein- Thus, an owner of a smart card 
can easily interact with a standard computer without installing a dedicated reader on the 
computer. Rather, the smart card owner will carry around a miniature adapter 110 which can 
communicate with a computer in a wireless manner. 
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It should be noted that although acoustic communication is preferred for at least one 
communication direction (computer to smart-card or smart^ard computer) one or both of the 
communication directions may utilize other technologies, temporarily or on a permanent basis. 
For example, the card may use the TRDA IR communications standard or the Bluetooth RF 

5 communications standard. 

In another example of the use of smart cards, a smart card is used to operate arcade 
games. Such a card may utilize the speaker and/or microphone of the game. Alternatively or 
additionally, the card may include information about the user, for example for billing. 
Alternatively or additionally, the information may include gaming information, for example 

10 how tar in the game the player is or the player's level, so me arcade game can be suitably 
configured. 

It should be noted that such an acoustic smart card may also be used as a customer 
card, as well as for an "electronic wallet", since information about the cardholder can easily be 
retrieved from the card. Also, it is simple to transmit information to the card. 

15 In a preferred embodiment of the invention, spatial angles between a sound source and 

a plurality of microphones arc <let<amined by analyzing phase differences al the microphones. 
Alternatively or additionally, other methods known in the art may be used, m a preferred 
embodiment of the invention, a relative location of a pulsing sound source and a plurality of 
microphones is determined by solving time of flight equations. Thus, the relative location of a 

20 smart card, an ID card (described below), an electronic device and/or a computer, relative to 
another electronic device, may be determined and used to control the operation and/or 
cooperation of one of the above electronic devices. 

In a preferred embodiment of the invention, four microphones are used to determine a 
three-dimensional position. For a source at r-(xo,yo»zo) and a plurality "i" of microphones at 

25 Mi=0q,yi,zi), *he distances between the source and the microphones are DHM*iH- The 
acoustic velocity, V. may be known, for example based on a known velocity in air. 
Alternatively, it may be determined by measuring the time of flight between a sound source 
and a microphone having fixed and known relative locations. A difference between distances 

is preferably defined as dDCiJ^-^j^dttJj')- * defincd 88 a diEFerenCC 

30 between time of arrival at microphone i and time of arrival at microphone j. For N 
microphones there are N-l independent differences dD. In an optimal configuration, the four 
microphones located at vertexes of a tetrahedron may be used to determine the location of a 
source. From practical considerations, such an arrangement may not be possible. Preferably, 
more than four microphones are used, so that a higher resistance to noise and/or a higher 
35 localization precision may be achieved. Tn a preferred embodiment of me invention, the three 
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dimensional position is determined by numerically or analytically solving three equations of 
thefbim: 

dI>^*dtCij)H|r-Mi|Htr-Mj||, where (ij) is preferably selected to be (1,2), (2,3) and 
(3,4). However any other independent three pairs of microphones may bo used. In some cases 
5 it is useful if one of the electronic devices operates as a transponder, which receives signals 
and sends back a signal indicative of the received signal and/or its time of flight 

A touch screen in accordance with a preferred embodiment of the invention utilizes 
acoustic transmission to detect the location of a touch implement, such as a pen. In a preferred 
embodiment of the invention, the position of the pen is r determined using one or more 
10 microphones and/or speakers mounted on the pen, which transmit and/or receive signals from 
a computer and/or other speaker and/or microphone controller. Possibly, a three-dimensional 
position of the touch implement is determined using tour acoustic elements, such as two 
microphones and two speakers. It is noted that a computer typically includes a modem 
£fl speaker, an internal speaker and/or a keyboard speaker, as well as sound-card speakers, m 

H 13 addition, some computers include an ultrasonic pointing device or other ultrasonic ports. In a 
fU preferred embodiment of the invention, the smart card can communicate using this ultrasonic 

|| con^cationport. 

CO In a preferred embodiment of the invention, location methods utilize a calibration 

process, in which the located implement is placed at one or more known location, so that it is 
O 20 possible to correct for the location of the speakers) and the mi crophone(s)/ Alternatively or 
It additionally, the calibration procedure is used to correct for propagation times (of the acoustic 

hj waves and/or of electronic signals which generate sounds) and/or far reflections, wavelength 

;~ dependent attenuation and/or broadband attenuation. 

A different type of touch screen in accordance with a preferred embodiment of the 
25 invention detects the location of a touch implement based on the detection and position 
determination (2D or 3D) of sounds generated when the touch implement touches the "touch 
sensitive" surface. 

A software protection method in accordance with a preferred embodiment of the 
invention comprises a passive ED tag which responds to an interrogation. In one example, such 
30 a tag is attached to the case of a software CD, such that the software will operate only if the 
computer on which it runs can interrogate the CD for a particular code, using ultrasonic or 
sonic signals. Alternatively or additionally, the ID tag may be attached to the CD itself and/or 
attached to (ox integrated with) an implement used for interacting with the software, for 
example a toy implement. Alternatively or additionally, the tag may be permanently attached 
35 (such that removal will damage it) to the case and/or monitor and/or other internal or external 
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element of the computer Alternatively or additionally, the ID tag is plugged in as a pass- 
through hasp, which possibly does not interact with the data lines which pass through it at all, 
but may use power from the power lines. Rather, the authentication of the software uses 
acoustic communication between the hasp and the microphone and/or speaker. Alternatively to 
5 protecting software, such a method may be used to protect an easily stolen device, such as a 
PDA or a laptop computer, which can use their internal speakers and/or microphones to detect 
the proximity of a required ID tag. * 

An authentication system in accoil^nce with a preftnati embodiment of the invention 
preferably uses a computer for authentication. In a preferred embodiment of the invention, a 
10 user may be authenticated by the computer dialing a user's personal communicator (for 
example a beeper, a cellular telephone, wireless telephone or a satellite telephone) and then 
listening for a ring of the personal communicator. Preferably, the personal communicator is 
m programmed for a distinctive ring, at least for calls originating from the computer. 

£3 Alternatively or additionally, a cellular network may instruct a cellular telephone to generate a 

^ 15 certain sound, responsive to a request (possibly by computer network) from die computer. 
f y Alternatively or additionally, a user calls up the computer (or the computer calls the 

JJj user) and the computer performs authentication by transmitting a certain sound to the personal 

SJ communicator and listening for that sound using its room microphone. Preferably, the sounds 

L are sonic. Alternatively or additionally, the sounds are ultrasonic for example 20kHz or above, 

y 20 In a preferred embodiment of the invention, the computer uses the detected sound to determine 
O attributes of the personal communicator, for example its distance from the computer. 

*X Alternatively or additionally to providing a telephone connection, a personal 

\!3 communicator may respond to an ambient room sound (for example an ultrasonic wave or a 

DTMF tone from a computer) with an ID code. Alternatively or additionally, a user may enter 
25 a code into a computer by dialing the code on his personal communicator and allowing the 
computer to receive the DTMF tones using the computer's microphone. 

In a preferred embodiment of the invention, an authentication method uses 
interrogation of an ID-tag instead of a personal communicator. Possibly, the ID-tag is a smart- 
card. In some embodiments of the invention, such a tag is interrogated directly using BP, in 
30 others, using sound and/or ultrasound (depending on the tag construction). 

Preferably, the tag responds with acoustic signals, possibly ultrasonic signals. 
Optionally, the tag u&es the energy of the interrogation signal to generate the response signal. 
Alternatively or additionally, the tag is interrogated using a tag-specific code. In a preferred 
embodiment of the invention, such a tag is used for computer log-on authentication, for 
35 example, when a wearer approaches a computer, the computer au t om a ti cally logs on to that 
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user. Alternatively or additionally, the computer may require the proximity of the ID card in 
addition to standard log-on procedures. Alternatively or additionally, the computer may 
periodically interrogate the ID card, to insure that the card wearer is still nearby. Alternatively 
or additionally, the computer may interrogate the card for user specific information, for 
example a voice ID or personal information. The computer can thus query the user for a voice 
response and compare the response (voice print and/or contents) to confirm the card wearer is 
a designated card wearer. 

r- U , c In sottte preferred embodiments of the invention, the card uses speech input In others, 

the card detects a response to a query by the absence, quality, number and/or other features of 
10 sounds, so no real speech recognition or matching is required. 

A user may wear two cards, one for general authorization and one including personal 
information. Thus, a computer may interrogate both cards. 

ffi In a preferred embodiment of the invention, an interrogated object receives the 

**** 

^ J ultrasound signal and sends it back to a microphone of the computer. In a preferred 

f-j 15 embodiment of the invention, the computer analyses the time of flight and/or other attributes 
of the transmission and determines a distance from, position to, velocity of motion and/or 
other spatial attributes of the object 

In a preferred embodiment of the invention, the object responds immediately to the 
q interrogation signal. Alternatively, the object delays its response to an interrogation signal, for 

20 example for a few milliseconds. Alternatively or additionally, the object transmits at a 
different frequency from the received frequency, for example 24kHz in response to a 20kHz 
query. Alternatively or additionally, the signal transmitted by the object is received by a 
transducer which then transmits the signal to the computer, for example acoustically or using 
electromagnetic coupling. Alternatively or additionally, the object may respond with an 
25 identification code. Alternatively or additionally, the object modulates its transmission with an 
envelope, which envelope preferable serves as an identification code and/or for transmission of 
information regarding a status of the object, for example a position of an arm of a toy. In some 
cases, the object relays information from a more remote object In the case of identification, 
the object may send an ID code even without prompting from the computer, for example 
30 periodically or by a user pressing a button on the object (or by flexing the object). 

In a preferred embodiment of the invention, the object amplifies the signal it receives 
using a discharge of a coil through a transistor, where the transistor serves as a variable resistor 
and/or as a wave-form controller. 

In a preferred embodiment of the invention, the smart-card or the ID tag are used as a 
35 pager. In one embodiment, computers in an office can locate an ID-tag by local interrogation 
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and then a message may be broadcast to a nearby telephone or intercom or using a nearby 
computer's loudspeaker. Alternatively or additionally, a visual message may be displayed on a 
computer screen (which is known to be at a location at which the ID tag is located) to notify a 
user of the computer that the user (or somebody in the room) is being paged. In another 

5 embodiment, the computers may be used to transmit information to the smart card which will 
itself generate an alert to the user, for example by shaking (dectrifying the piezoelectric film) 
or bymaking a sound. In another embodiment, a digital telephone network is used to generate * * h 

. r . . aad/or receive ultrasonic signals which can be used to communicate with a smart card. An - i i t 
narrow bandwidth system, for example an analog system may be used if audible sounds are 

10 used. 

In a preferred embodiment of the invention, a wireless telephone system uses handsets 
which communicate with base stations, for example computers or telephones, using ultrasonic 
communication, as described herein. In a preferred embodiment of the invention, an office 



£3 telephone or computer network can serve as a local cellular network for communication, by 

iTi 13 keeping track which baso-stations are in communication with which handsets and by providing 
til the ability for a base station to locale handsets and for a handset to change base stations. 

ass 

Fig. 4A is a schematic illustration of an Internet transmission pathway for sounds, in 
% j accordance with a preferred embodiment of the invention. When a smart card 40 (or 

interrogated badge) transmits infonnation-canying sounds to a computer, these sounds may be 
20 analyzed on the computer. Alternatively or additionally, the sounds may be transmitted from 
the computer to a remote computer, where they are analyzed. In a preferred embodiment of the 
invention, a local client computer 62 receives sounds and transmits them over an Internet 60 to 
a server computer 50. Alternatively to using an Internet, an Intranet, a I -AN, a Wan or another 
type of computer data network is used. It is noted that there exist standard protocols for 
25 transmitting sounds over networks. Thus, there is little or no need for changes in the hardware 
and/or software configurations of the communication pathway, especially not of client 62. The 
pathway can also work in the other direction, for example, when a toy downloads 
programming from a remote server and the programming is stored as a toy-understandable 
sound file, or when die server interrogates the smart card. It is noted that playing of sound is 
30 also supported by standard Internet protocols. Alternatively or additionally, a smart card may 
serve as an interrogated ID tag which is used to control access to and/or billing of usage of an 
Internet site. In one example, whenever a user requests a service from the Internet, the 
existence of a local smart card is ascertained. Billing information is preferably transmitted to 
the card. Periodically, the card is interrogated (possibly by a third party), preferably over the 
35 Internet or a telephone connection, for the existence of charges. 
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In an example of a financial or business interaction over an Internet, one or more of the 
following three levels of security may be achieved. First, the presence of the card, which can 
be required by local and/or by remote software. Second, confirmation of the card wearer 
identification using personal information. Third, an identification of the calling computer 
5 (which should preferably match the wearer profile and/or information stored on the card). 
Additionally, it is noted that there exist standard mechanisms for transmitting sound over an 
Internet, LAN, WAN ox a telephone line. Thu^ some or ultrasonic communication, for 
example from a smart card or an ID card may \yz ipsacHced aver a tele^fccns connection or over 
an Internet connection. These communications may include encrypted communications, for 
10 example using RSA, DES, triple DES or TEF encoding or other public-key algoritnms. 
Ahcrnativcly or additionally, the communication may use DTMF or DTMF-like tones. 
Alternatively or additionally, such communication may be used for telephone calling cards. 
Alternatively or additionally, such communication may be used for transmitting credit card 
information. In a preferred embodiment of the invention, a credit card includes a sound output 
15 (optionally encrypted). Thus, a user can "swipe* 1 his card at any electronic device which 
includes a microphone (optionally a speaker, for two way communication) and suitable 
ffi software/hardware, for example a home computer. Possibly, swiping software may be 

~rl downloaded as a Java applet 

= Generally, any type of smart card interaction, for commercial and/ox far personal uses 

H 20 may be implemented using the acoustic transmission methods described herein. 

In a preferred embodiment of 1he invention, a smart card is used for purchasing 
services and/or goods in a store. La one example, shown in Fig. 4B, a person enters into a 
restaurant, carrying a smart card 120* This smart card may be used for several activities in the 
restaurant, for example, contacting a waiter's communicator 122, selecting a free table (based 
25 on a list of tables transmitted by a central computer 124) and/or reviewing a menu and "today's 
specials" also transmitted by central computer 124. Possibly, some of this information and 
other information, such as average waiting time, current line length, average meal costs, 
specific dish costs, delay until a particular dish is ready, dishes which are out of stock and in 
general any question that a customer might ask a waiter, may even be answered when the 
30 client is outside the restaurant. The client may query for this information or it may be 
continuously presented. It is noted that some types of query responses require a control of 
details and numerical information which are beyond the ability of most waiters (but not of a 
central computer). 

Once the customer is seated and has selected from a menu* the client can track the 
35 progress of his dish, for example by communication with a kitchen computer 132. In some 
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restaurants, the client is a regular customer (possibly the card is a "member's card") and the 
card may be used to place the order. Possibly, the client can order his "usual". Alternatively, 
especially if the smart card includes a display (or is implemented using a PDA) the client can 
order directly using the card. In some cases a card may not have a sufficient transmission 
5 range and a local transducer, such as on the table or on walls or ceilings are provided. This 
transducer may be replaced by a remote loudspeaker/microphone system for the central 
computer. In some cases, the smart card (possibly RF rather than acoustic) may be used at a 
distance, for example. 1, 5 10 or even 15 rrvstsrs . Alternatively the card may be used at a short 
distance, for example, 0.5 meters or even at contact or near contact distances. 
10 At the end of the meal, the bill total and/or the bill details are downloaded to the card. 

Using the card, the user can authorize payment and/or add a tip. The payment authorization is 
preferably transmitted by central computer 124 to a remote credit card company 126 for 
verification. Possibly, the smart card instructs the central computer to print out a paper slip to 
be signed. However, a digital-type signature is preferred- In an electronic wallet situation, no 
U 15 credit card company is vised. Instead "cash" is withdrawn from the smart card. 



V. ' 



\y In a store embodiment, or in a display-case type restaurant, the smart card may also be 

rf| used to interrogate certain displays for further information, for a demonstration or for ordering. 



Id many situa'dons, there will be more than one active smart card in a restaurant at a 
single time. In Fig- 4B a second smart card 130 is shown. In a preferred embodiment of the 
£3 20 invention, smart cards 120 *M 130 coordinate so that they do not both transit at a same time. 
pi In one example, -die central computer assigns timet, frequency or coding (CDMA) slots. In 

Ul another example, an ALOHA algorithm is used to avoid collisions. 

In a preferred embodiment of the invention, two smart cards can directly communicate, 
for example to exchange business mfbrmation. A particular situation is at a technology show 
25 where several persons from a single company will each view part of the show and interrogate 
information from displays using their smart cards. At the end of the day, these persons will 
preferably consolidate their fitting by the smart cards exchanging information or by 
downloading the information from the smart cards to a central computer. 

Fig. 5 is a schematic block diagram of a communications tap 102 for a computer 100, 
30 in accordance with a preferred embodiment of the invention. One problem with computer 
communication is setting up the hardware and software for communications. In the 
configuration of Fig. 5, a tap is preferably placed on communication line to an existing 
peripheral 104. Thus, a user may not be required to even access a back part of a computer, let 
alone a computer's inside. A toy 106, an electronic device and/or a smart-card preferably send 
35 and/or receive signals from tap 102. Additionally or alternatively, toy 106 may use one tap for 
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receiving and one for sending. Possibly, a toy uses taps only for one direction of 
communication. 

In a preferred embodiment of the invention, the tap is placed on a cable to a printer, a 
network cable, a camera cable and/or a SCSI connection. Additionally or alternatively, the tap 
is placed on a serial cable, for example a mouse cable. Additionally or alternatively, the tap is 
placed on a modem line, for example on a telephone line or by plugging the tap into another 
telephone socket, to be received by the modem. Additionally or alternatively, the tap is placed 
cn a game controller line. Additionally or alternatively, the tap is placed on a loudspeaker line. 
This type of tap can detect signals which cannot be reproduced by the loudspeaker, for 
example very high frequencies. Additionally or alternatively, the tap is placed on a 
microphone line, possibly using the microphone line and/or the microphone itself as a sonic, 
ultrasonic or non-acoustic antenna (eg., RF). Additionally or alternatively, the tap is placed on 
ff\ a display cable line. 

^ In a preferred enabodiment of the invention, the tap includes an electro-magnetic 

fij 15 coupler, which can induce signals in a cable which passes through ox near the tap. Additionally 
or alternatively, the cap can detect signals in the line and transmit them to toy 106. In a 
preferred embodiment of the invention, the signals are at a different carrier frequency and/or 
signal frequency than the usual signals passed along the line. Additionally or alternatively, the 
f~j signals travel in an opposite direction (input signals on an output line, such as a printer or 

lU 20 output signals on an input line, such as a mouse). Additionally ox alternatively, the signals 
rjl encode information which information is detected and removed from the data stream in the 

Ul computer. Additionally or alternatively, the signals are asynchronic on a syrichronic line. 

*~ Additionally or alternatively, the signals are transmitted only when no signal is expected by 

the computer and/ox the peripheral. 
25 In an alternative embodiment of the invention, a piezoelectric actuator (ox other 

vibrating element) is connected to a mouse (or a microphone). The actuator causes the mouse 
to shake at an amplitude of one or two screen pixels (or less) and the shaking is detected by 
software in the computer as signals fr om the toy. A return signal may be transmitted to a tap 
associated with the actuator, along the serial cable, with the signal preferably being coded to 
30 be recognized by the tap and/or ignored by the mouse. 

In an alternative embodiment of the invention, toy 106 conimumcatcs with computer 
100 using a speaker (internal and/or sound card) and/or a microphone of the computer. 
Preferably, toy 106 receives traiismissious from the computer loudspeaker and/or sends signals 
to the computer microphone. Additionally or alternatively , signals axe transmitted to toy 106 
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via the microphone and received via the loudspeaker, depending on whether the hardware 

supports such a reverse connection. 

In an alternative embodiment of the invention, toy 106 sends signals to computer 102 

using a tap which presses keys on a keyboard attached to computer 100. Preferably the key 
5 used is a shift key. Additionally or alternatively, signals from the computer are detected by 

detecting illumination of LEDs on the keyboard, for example a "Num Lock" LED. 

Alternatively or additionally, the tap detects illumination of other LEDs on a computer, 

for example power, sleep, CD-ROM and/or hard disk LEDs. Alternatively or additionally, the 

tap detects information transmitted via noise or vibration generated by activation and/or 
10 modulation of the activity of mechanical components of the computer, for example diskette 

drives, disk drives and CD-ROM drives. Alternatively or additionally, tbe tap detects an 

elcctromagactic signal generated by power surges to the devices, for example a CD-ROM 

when it is powered. 

J? la * preferred embodiment of the invention, a tap "learns" the electromagnetic and/or 

M 15 acoustic profile of a particular computer and also learns the effects of various commands on 
j]J this profile. When a computer desires to communicate with a tap, it preferably modifies the 

?ii profile using those commands which are determined to have the greatest, most noticeable 

jfl and/or fastest effect on the profile. 

Additionally or alternatively, toy 106 utilizes a transducer which plugs into a parallel 
20 port, a serial port and/ox is optically coupled or placed near an IR port. Preferably, the 
? g transducer is a pass-through transducer, through which a printer and/or other peripherals may 

U communicate normally with a computer. 

J\ In a preferred embodiment of the invention, the tap and/or transducer can automatically 

detect which type of cable is tapped/port is connected to. Preferably, such detection is by 
25 analyzing amplitude, frequency and/or synchronization of signals passing through the lines. 
Additionally or alternatively, the computer detects which line is tapped, by delecting particular 
inferences on that line. Alternatively or additionally, software on tbe computer sends test 
signals along the lines, to be detected by the tap. Possibly, the tap can delect the signals even 
without being programmed with the type of line on which the signals are transmitted. 
30 Alternatively, when a tap is used, a configuration program is run so that a user can define to 
the tap and/or the computer what is being tapped. 

In a preferred embodiment of the invention* a smart card directly taps the computer, for 
example using a coil embedded in the smart card to detect signals being transmitted over data 
lines. 
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In a preferred embodiment of the invention, suitable software is installed on computer 
100. Preferably, the software is self installing. Preferably, the computer is not used for any 
other use while toy 1 06 is cornmuni eating with it. Additionally or alternatively, the software 
can differentiate between < *reguiar" signals and signals related to the tap. In one example, a 
5 provided keyboard driver may detected special codes and/or data sequences on the keyboard 
line and remove mem from the received data, passing only the rest of the received data to an 
operating system of computer 100. Additionally or alternatively, a provided mouse driver may 
detect spurious an&'or small ixiouse mc /emsnts, and recognize them as being tap related 
signals. Additionally or alternatively, a printer driver can recognize data on the cable as not 
10 writing from the printer but from a tap. Additionally or alternatively, data sent to the tap is 
preferably sent as data which will be rejected or ignored by the peripheral, for example having 
incorrect parity settings or other intentional errors. Ahcmatively or additionally to using a tap 
for cornmunication with a toy, such a tap may be used to attach a peripheral to computer 100. 

In a preferred embodiment of the invention, the signal received on the computer is used 
("» 15 to modify a c omput er game and/or to generate commands to other toys, preferably using 
sounds generated by the computer. Thus, a computer game in which a computer display 
Cfl responds to external sounds, is preferably provided. 

The acoustic communication may also be used to corrmiunicatc between a play 
implement and a computer game, for example between a sword and a play-station. In one 

0 20 example, a light-pen or a light-gun tran smits to the play-station a signal responsive to pixel 

1 jj 

q intensities which are detected by a photo-detector thereon. Alternatively or additionally, a 

*J synchronization signal is transmitted from a computer and/or a set-top box to the pen, to 

~g synchronize the pixel detection with the TV raster scan. These transmissions may be additional 

to- or alternative to- transmission of position and/or orientation. Alternatively or additionally, 
25 the play implement transmits the status of controls thereon. Alternatively or additionally, the 

transmission is used to transmit information to be displayed on the implement, for example to 

light up lights thereon, display a number of kills thereon and/or drive text and/or graphics 

displays thereon. 

In a preferred embodiment of the invention* a bowling game is provided, in which a 
30 computer detects sounds generated by a moving bowling ball and knocks over pins on a 
display. Preferably, a soft ball is used, preferably, the motion of the ball is deterxoined relative 
to the computer irdcrophonc and/or speakers, as described herein, Alternatively, an 
independent sound generator and/or receiver may be utilized, which sound clement is 
preferably integrated with a computer using minimal ty -in stalled hardware, as described herein. 
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In another example, a computer displays a thrown ball, for example a baseball and 
determines a "hit" based on detected motion of a baseball baL In another example, a computer 
goalie attempts to stop a real ball kicked by a player. The position and/or other motion 
attributes of the ball are preferably determined by acoustic distance determination using only 
5 the hardware already installed in a standard computer, for example as described herein, In 
another example, a boxing match a computer tracks motion of a glove, to detect hits on a 
computer figure and/or to emulate evasive maneuvers. Alternatively or additionally, the 
* computer tracks motion of the player, to aim its own punches and/or to asses a score. 

Optionally, the computer is used to display motion of a second remote player. Alternatively or 
10 additionally to boxing, the computer may track motion of sources (preferably with implanted 
sound devices or with a wrist band sound device). Alternatively or additionally, the computer 
may track positions and/or alignments of toy guns and/or of players holding the guns. Possibly 
a map of a room may be provided so the computer can determine if a gun has a line of site in 
the particular loom. 

15 In a preferred embodiment of the invention, the signals generated by a toy are 

inadvertently generated, for example, sounds generated by a wheel rotating or an appendage 
flapping. Additionally or alternatively, the signals are included in a generated action, for 
^ example, a quack sounded by a toy, which may be modulated by a signal, a blinking light, 

U whose blinking may be modified by the signal or a waving gesture which may be modified 

iu 20 and/oT its duration or amplitude changed, to convey a signal. Additionally or alternatively, the 
signals arc determined by analyzing a response, for example dilTer cTt t i nti n g between different 
IB sounds produced by a first toy to decide which sound to make in response. Additionally or 

alternatively, the signal may be additional to generated actions, for example, an extra beep 
after a "quack". Preferably, such additional signals are made as unobtrusive as possible, for 
25 example by being ultrasonic. 

In another example, a computer and/or a toy can respond to DTMF tones generated by 
a telephone handset, a wireless telephone, a cellular telephone or even a play telephone. 

Fig. 6 is a schematic illustration of an unobtrusive computer checkup in accordance 
with a preferred embodiment of the invention. A user 142 is using a computer 140. A user 146 
30 wishes to interrogate computer 140, for example to determine a networking problem. In a 
preferred embodiment of the invention, a smart card 144 (or other electronic device) can 
communicate with computer 140 using an acoustical- or a tap- channel as described above, 
without rnterfering with the activities of user 142. Alternatively or additionally, smart card 144 
may be used to interrogate an interface-less device, such as a hub 148. One advantage of 
35 acoustical communication for these uses is that they do not generate a considerable amount of 
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RF interference and do not require major (if any) changes in a (significant) install base of 
hardware. In a preferred embodiment of the invention, hardware devices, such as hub 148 and 
computer 140 continuously "burn" their status, so that the status can be discerned by 
eavesdropping on the hum, without needing to interrogate the hardware. 
5 Fig. 7 is a schematic illustration of a computer communication setup using acoustics, in 

accordance with a preferred embodiment of the invention. A computer 152 includes a 
microphone 156 which is used for detecting activity sounds of other islectrdnic ' and/or 
mechanical devices. The activity sounds may comprise natural sounds -fox example ^i page* 
sorter being used in a photocopier. Alternatively or additionally, they may comprises indicator 
10 sounds, for example a beep generated by a fax machine when a fax comes in. Alternatively or 
additionally, they may comprise artificial sounds, for example a special information carrying 
sound generated specifically for the benefit of computer 1 52. 

In a preferred embodiment of the invention, a computer 152 transmits indications of 
the sensed activities to a remote computer, such as computer 154. Thus, a user at computer 154 
?) is can be informed of a fax coming in or of an unanswered telephone call even if he is in a 
fij different room and the fax machine is not connected to standard computer -network. 

J\; Alternatively or additionally, the analysis of sounds detected by microphone 156 can 

vj be used to determine other occurrences at computer 152. In one example, microphone 156 can 

*^ be used to log the habits of a user, including, telephone conversations, numbers dialed (by 

l~\ 20 detecting the DTMF sounds), sounds of papers being shuffled, breathing sounds, snoring of a 
□ sleeping user, average number of rings until a call is answered, and typing habits. Alternatively 

or additionally, microphone 156 can be used to detect an occupancy of a room or glass 
\U breakage, possibly serving as a burglar alarm. 

Alternatively or additionally, the microphone may be used to detect electromagnetic 
25 impulses generated by operating devices. Typically, each device has a different 
electromagnetic signature. Different signatures may be generated when the device is switched 
on or off and when the device is operated. Thus, a computex-nricrophone combination can be 
used to detect the operation of devices, such as photocopies, door chimes and computers. In a 
preferred embodiment of the invention, a video input card is used to analyses higher 
30 frequencies of electromagnetic radiation than those detectable by a microphone-sound card 
combination. It can thus be appreciated that noise signals which are usually rejected by signal 
processing algorithms may be analyzed to detect important ambient information. 

In a particular preferred embodiment of the invention, an electronic commerce systems 
comprises! 
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(a) a computer (desktopAaptop/hand-held) with a regular microphone (built in monitor 
or computer or external) or special some/ultrasonic microphone and at least one speaker, 

(b) a card or other device which has an acoustic receiver a processing unit an acoustic 
transmitter and input and/or output filtration and amplification circuits; 

5 (c) a communication protocol used by the card and computer; 

(d) software on the card side; 

(e) software on the PC side; and 

(f) a security eahsme, integrated with, fee oftier components. 

In the smart card, the acoustic receiver can be regular capsule microphone, or an 
10 ultrasonic type microphone, possibly specific for a particular frequency or frequency range 
used. The processing unit can preferably receive signals through an A/D converter and/ox 
digital communication and can detect signal frequencies needed for the communication 
protocol. Preferably, the processing unit used has sufficient power (a few MIPS), and includes 
some (on-chip or off-chip) memory, especially for storing and/or generating a cryptographic 
signature. A Microchips P1C508 processing unit is preferably used and appendix "C" lists 
microcode for it. In some cases, special ultra-low power circuitry may be desirable. The 
acoustic transmitted can preferably generate a strong atmosphere wave. It is noted however, 
that only a small amount of power is required for short range transmissions. Additionally, the 
transmitter may generate waves in solids, for example to be carried by the case of the 
20 computer comprising the microphone 

m a preferred embodiment of the invention, the inpat/output filtration circuits comprise 
op-amplifiers with filters for specific frequencies for input and output, dependent on the 
communication protocol used. If non-audible frequencies are used, the filters should decrease 
power in audible frequencies, to reduce annoyance of a user 
25 The communication protocol is preferably a digital binary code in which the bits are 

transmitted using Frequency Modulation, Pulse Width Modulation, On-Off Keying and/or any 
combination of the above. Error correction codes, for example parity, Gray or Hamming 
codes, as known m the art may be used. It should be noted that the range of available 
frequencies may be Umitcd if ultrasonic frequencies are used, due to degraded capabilities of 

30 the computer sound card. 

An exemplary software for the smart card is provided as an appendix "C" attached 
herewith. This software demodulate the signals received and convert them to data bits, either 
by time domain analysis or by Fourier analysis. Thereafter, error checking is preferably 
performed. The received information may be decrypted (if necessary). Alternatively or 
35 additionally, the received information may be encrypted, verified and/or signed, in order to be 
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stored in local memory. The local memory may comprise ROM, RAM, EPROM, EPROM 
and/or other types of memory as known in the arL Information to be transmitted may be 
encrypted before transmission. 

An exemplary software for the PC, written in Visual Basic version 6.0 and in Delphi 
5 version 4.0 (a DLL) is provided as an appendix "A n and an Appendix "B" respectively, 
attached herewith. This software receives a detected signal, filters it, and opens the protocol. 
Preferably, the software checks for errors using 1IR Band Pass and/or low pass filters. 

The received find 'filtssed signal is then demodulated, into data bits, for example, by 
time domain analysis ox by Fourier analysis. Data transmission errors are preferably corrected. 
10 The data may then be locally analyzed and/or transmitted to a remote location, for example a 
seller's computer. In some embodiments, this software is written in an Internet Language, such 
as Java or ActiveX. 

In a preferred embodiment of the invention, the acoustical detection uses the maximnm 
f 3 resolution and/ox sensitivity afforded by the microphone, i.e., going below the noise threshold 

lZ 1 5 as defined for audio uses. Alternatively or additionally, repeating and/or periodic ambient 
ry sounds are detected and removed or disregarded from the input signal. In a preferred 

» = embodiment of the invention, ambient sounds are characterized as such during a calibration 

til 

sj step which may be performed periodically. 

In a preferred embodiment of the invention, the following security scheme is used: the 
20 card has stored thereon a private key of owner. A facilitator has public keys of all users and is 
O accessible via an Internet or other means. In some cases the seller is also the facilitator. 

^ In an exemplary embodiment, a user connects to a seller's site, decides on a purchase 

\y and when he is done he activates the card which in tarn signals a local computer to transmit 

purchasing data (e.g., a catalog number) and a random number, back to the card. The card in 
25 return, signs on the data and the number with its private key and sends the signature back to 
the computer. The computer receives the signature and sends it to the seller. The seller then 
verifies the signature, for example using a locally stored public key or with the help of the 
facilitator. The supplier may save the purchasing data and signature for his proof of purchase. 
The facilitator can also server to check if the random numbers are really random or to supply 
3D such random numbers. 

This scheme can use any cryptographic method for electronic signature, for example 
RSA or methods which are not based on publicum vate keying. 

In some embodiments, the card is used only for transmission of a purchase 
authorization, possibly without receiving any data from the computer, possibly, such 
35 information is entered directly into the card, for example using buttons on the card. 
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Alternatively, the card only transmits a "usage" authorization, which is unrelated to the 
particular purchase. Such an authorization is preferably a one-time, temporally limited 
authorization, which expires after a short time, for example 30 seconds. In one such exemplary 
embodiment, the card sends information using frequency modulations and using a start and a 
stop bit A synchronization byte is preferably sent in the beginning of transmission. Replies 
from the seller may be locally stored on the computer for use by the card owner. 

In a preferred embodiment of the invention, the seller and/or the facilitator can 
download advertisements and/or operating instructions to the smart card, possibly as part of a 
purchase agreement. This is especially useful in toys which are programmed using sounds 
downloaded from the Internet Some of the downloaded sounds may comprise an audio (or 
visual - for suitable toys) user manual. 

Pigs. 8 A and 8B comprise an electronic schematic of a smart card in accordance with a 
preferred embodiment of the invention. A brief explanation follows: 

The reception of a signal is via a miniature wide band microphone, and the 
transmission is via a low profile miniature diaphragm. The sound frequencies axe in the range 
of 18 KHfe to 22 kHz* in order to make the data transfer inaudible. However, lower (audible) 
frequencies can be used when the computer microphone has a poor performance, or when 
otherwise desirable. 

Fig. 8B describes a receiver circuit including a narrow band amplifier, with an 
Automatic Gain Control (AGC). U1B provides reference DC voltage for the whole analog 
subsystem. U1A is a preamplifier for a miniature wideband microphone XI, with a gain of 
38db. A coil LI is part of a resonator with a Q fector of 4. U2A and U2B form an AGC 
through a JFET transistor Ql. The AGC provides variable gain in the range of Odb to 26db. 

The circuit detects an audio signal in the relevant band, and then compensates the gain 
by the AGC to form a stable output signal with amplitude of approximately 2Vpp. The AGC 
needs a maximum time of 4 mSec to stabilize the gain. This time constant is controlled by the 
value of RIO. After reaching the desired level, it changes it with a slow time constant of lsec, 
which is determined by the value of R12. 

The analog signal is then fed into a comparator U3, which produces a square wave with 
the frequency of 'die analog signal. This signal can be processed digitally by microcontroller 
U4. The analog signal can also be digitized by an A/D for more accurate processing in a more 
sophisticated microprocessor. 

Fig. 8A shows a transmitting circuit A speaker SP1 produces the transmission. It is 
driven by a FET U5. A capacitor C18 is charged to full voltage after approximately ImSec, 
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allowing small amplitude of speaker driving signal at ignition, in order to make the signal 
inaudible. 

A part listing follows: 

Item Part Reference Note 







1 


ft 1nP 

u. lur 








L 


U.lUr 


Clo 








U. lUr 


1-15 






>* 


U.llix* 


CI 6 






> 


u.lur 


C17 






O 


u.iur 


C19 






"7 
/ 


i or 


R20 






Q 

s 


l.5mHy 


LI 




IS 


9 


IK 


R9 






10 


1M 


R12 






11 


luF 


C8 


U * 
f ^ 
£J 




12 


5K 


R19 




13 


5K 


R17 


i„L 
r 


20 


14 


10K 


RIO 


!U 




15 


lOnF 


C7 


Ft 1 

ry 




16 


lOnF 


C9 






17 


lOnF 


C10 


UJ 




18 


lOuF 


Cll 




25 


19 


lOuF 


C14 


3 




20 


lOuF 


C18 


o 




21 


39K 


Rl 


: > ! 




22 


39K 


R2 


□ 




23 


39K 


R15 


i t * 


30 


24 


47K 


R6 






25 


47K 


R8 






26 


47K 


R16 






27 


47nF 


C4 






2fi 


50pF 


C6 
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29 


100K 


R5 






30 


100K 


Rll 






31 


100K 


R13 






32 


100K 


R14 






33 


100K 


R21 




40 


34 


lOOpF 


CI 






35 


100 


R18 






36 


150K 


R7 






37 


150pF 


C2 






38 


ISOpF 


C5 




45 


39 


750 


R3 






40 


750 


RA 






41 


79167-001-001 






42 


^2uF 


C3 






43 


BATTERY 


BT1 




50 


44 


BATTERY 


BT2 



Si miniature switch 
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• 





45 


XI 


EK-3032 miniature wideband microphono 




46 


FT-12T 


LSI 


low power high frequency diaphragm 




47 


KN01P3ASAQ 






48 








5 


49 




TT1 A 


low current wideband amplifier 




50 


T A^147 


U1B 


low current wideband amplifier 




51 


T A/f^1 A*} 


TT9 A 


low current wideband amplifier 




52 


J_«J.VJ.U X 


KJ JJJLJ 


low current wideband amplifier 




. 53 






low current high slew rate comparator 


10 


54 




U L 


low Vf low leakage current diode. 




55 


, M3R0530T1 


D2, 


low Vf low leakage current diode* 




"56" 


• MBR053GT1 


D4 


low Vf low leakage current diode 




57 


MBROS30T1 


D5 


low Vf low leakage current diode. 




58 


PIC12C509 


U4 


microcontroller 


15 


59 


SSTJ77 




JFET 




60 


Si3454DV 


U5 


low Rds FET 



u 

□ 



The present invention has been described in terms of preferred, non-Hmiting 
embodiments thereof. It should be understood that features described with respect to one 
20 embodiment may be used with other embodiments and that not all embodiments of the 
invention have all of the features shown in a particular figure, in particular, the scope of the 
invention is not defined by the preferred embodiments but by the following claims. Section 
titles, where they appear, are not to be construed in limiting subject matter described therein, 
rather section titles are meant only as an aid in browsing this specification. When used in the 
25 following claims, the terms "comprises", "ccraprising ,T , "includes", "including" or the like 
"including but not limited to". 
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CLAIMS 

1. A method of communicating with an electronic device, comprising: 

5 providing a computer having a sound receiving and generating sub-system including a 

microphone; 

transmitting from a source at least one ultrasonic acoustic signal, encoded with 
mfonnation. to the computer; and 

receiving said at least one signal by said microphone, to be detected by said computer. 

10 

2. A method of communicating with an electronic device, comprising: 

providing a computer having a sound receiving and generating sub-system including a 
microphone and a loudspeaker, 
^ 1 transmitting from a source at least one acoustic signal, encoded with information to the 

y M 15 computer, 

receiving said at least one signal by said microphone, to be detected by said computer; 

~~ and 



^ transmitting to said source, using said loudspeaker, at least a second acoustic signal, 

encoded with information, in response with, said detected signal. 

O 20 

3. A method according to Haim 2, wherein at least one of said at least one signal and at 
y least a second signal comprise an ultrasonic signal. 

4. A method of communicating with an electronic device, comprising: 

25 providing an electronic device having a sound receiving and generating sub-system 

including a microphone and a loudspeaker; 

transmitting from a source at least one ultrasonic acoustic signal, encoded with 
information to the electronic device; 

receiving said at least one signal by said microphone, to be detected by said electronic 
30 device; and 

transmitting to said source, "Ring said loudspeaker, at least a second ultrasonic acoustic 
signal, encoded with information, in response with said detected signal - 

5. A method according to claim 4, wherein said electronic device comprises a computer. 
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6. A method of rorranunicatiiig with an electronic device, comprising: 

providing a telephone having a sound receiving and generating sub-system including a 
microphone; 

5 transmitting from a source at least one acoustic signal, encoded with information to the 

telephone; and 

receiving said at least one signal by said microphone, to be used locally by said 
telephone. 1 

10 7. A method according to claim 6, wherein said acoustic signal comprises an ultrasonic 
signal. 

8. A method of communicating with an electronic device, comprising: 

providing a computer having a sound receiving and generating sub-system including a 
P is microphone; 

FU transmitting from a source at least one acoustic signal, encoded with information to the 

fjj 

computer, and 

receiving said at least one signal by said microphone; and 

forwarding an indication of said information to a remote computer, over an Internet 



O 20 

lif 9- A method according to claim 8, wherein said indication comprises a sound file. 

10. A method according to claim 8, wherein said indication comprises a data file. 

25 11. A method according to any of claims 8-10, wherein said acoustic signal comprises an 
ultrasonic signal. 

12. A method according to any of claims 1^3»5 or 8-1 1, wherein said computer comprises 
a PDA (personal data assistant). 

30 

13. A method according to any of claims 1 A3,5 or 8-1 1, wherein said computer comprises 
a portable computer. 

14. A method according to any of claims 1,2*3,5 or 8-11, wherein said computer comprises 
35 a desk-top computer. 
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15. A method according to any of claims 1,2,3.5 or 8-14, comprising processing said at 
least one sound by said computer. 

5 16. A method according to claim 15, wherein processing comprises extracting said 
encoded information. 

17- A method according to claim 15 or slaiia A6* w!ht3X<e$ai s^&piw&ssfrig comprises 
determining a distance between said microphone and said source. 

10 

18. A method according to any of claims 15-17, wherein said processing comprises 
determining movement of said microphone relative to said source, 

; j 19. A method according to claim 18 wherein said movement comprises angular movement 

»b 15 

20. A method according to claim 1 8 or claim 1 9, wherein said movement comprises 



ft * 

T Li 



SH translation. 

%| 



O 

hi 

-ft 



21. A method according to any of claims 1 5-1 7, wherein said processing comprises 
20 determining a spatial position of said microphone relative to said source. 

22, A method according to claim 21, wherein said spatial position is a one-diinerjusi onal 
spatial position. 

25 23. A method according to claim 21, wherein said spatial position is a two-dimensional 
spatial position. 

24. A method according to claim 21, wherein said spatial position is a three^imensional 
spatial position. 

30 

25. A method according to any of claims 15-24, wherein said processing comprises 
emulating a touch screen using said received at least one sound. 

26. A method according to any of claims 15-24, wherein said processing comprises 

35 emulating a pointing device using said received at least one sound. 
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27. A method according to any of claims 1 5-24, comprising controlling at least one action 
of a toy, responsive to said received at least one sound 






5 


28. A method according to claim 5 or claim 6, wherein said any of claims 1-15, wherein 
said electronic device comprises a wireless communication device. 








29- * A inethod assorting to claim 4, wherein said electronic device comprises a computer. 






10 


30. A method according to claim 4, wherein said electronic device comprises a computer 
peripheral. 








31. A method according to claim 30, wherein said peripheral comprises a printer. 


• 


i \ \ 

ru 

'M 


15 


32. A method according to claim 4, wherein said device comprises a toy. 

33. A method according to claim 32, wherein said information comprises programming 
information. 




u 


20 


34. A method according to claim 32, wherein said information comprises music. 




n 

■5ST 

W 


25 


35. A method according to any of claims 1-34. wherein said source comprises a toy. 

36. A method according to claim 35, wherein said information comprises stored player 
input 

37. A method according to any of claims 1-34, wherein said source comprises a smart card. 


• 




30 
35 


38. A method according to any of claims 1-34, wherein said source comprises a wireless 
communication device. 

39. A method according to any of claims 1-34, wherein said source comprises a computer. 

40. A method according to any of claims 1-34, wherein said source comprises a computer 
peripheral. 

35 
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41 . A method according to any of claims 1-40, comprising performing a financial 
transaction responsive to said at least one transmitted signal. 

5 42. A method according to any of claims 1-41, comprising identifying a person responsive 
to said at least one transmitted signal. 

^. i ^ A method according to any of claims 1-42, wherein said information comprises 

personal information. 

10 

44. A method according to any of claims 1-43, comprising logging into a computer system 
responsive to said at least transmitted signal. 

JJ3*. 

y * 

Q 45 - A method according to any of claims 1 or 6-1 1, comprising transmitting at least a 

r-* is second acoustical signal responsive to said received at least one signaL 

W 

fl 46 - A method according to any of claims 2 ox 5-10, wherein said acoustic signal comprises 

^ # human audible sound. 

Q 

y 20 47 - A method according to claim 46, wherein said sound has a main frequency over 10kHz. 

O 

-sO A method according to any of claims 2 or 5-10, wherein said sound has a main 

*fj frequency which is infra-sonic. 

25 49. A method according to any of claims 1-48, wherein said information is encoded using 
below human-threshold amplitude. 

50. A method according to any of claims 1-48, wherein said information is encoded using 
below human-threshold amplitude variations. 

30 

51. A method according to any of claims 1-50, wherein said sound is generated at a 
frequency outside a normal operating frequency for said sound subsystem. 

52. A method according to any of claims 1-51, wherein said sound subsystem is designed 
35 for generating musical sounds. 
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53. A method according to any of claims 1-52, wherein said sound subsystem comprises a 
sound card. 

5 54. A method according to claim 53, wherein said sound card comprises a SoundBlaster 
compatible sound card. 

55 . A method according to any of claims 1 -54 5 [ ^h^ro m ss ; cd sdund-s? jb^^system is designed 
for communication with a human operator. 

10 

56. A method according to any of claims 1,3, 4 or 1 1, wherein said ultrasonic signal has a 
main frequency below 50kHz. 

cn 

□ 57. A method according to any of claims 1,3, 4 or 11, wherein said ultrasonic signal has a 

!T. 15 main frequency below 35kHz. 

fy 

^ 58. A method according to any of claims 1, 3, 4 or 11, wherein said ultrasonic signal has a 

\j main frequency below 25kHz. 

p 

y 20 59. A method according to any of claims 1, 3, 4 or 1 1, wherein said ultrasonic signal has a 

p~ main frequency of about 24kHz. 

UJ 

\3 60. A method according to any of claims 1, 3, 4 or 11, wherein said ultrasonic signal has a 

main frequency of about 22kHz. 

25 

61. A method according to any of claims 1, 3, 4 ox 11, wherein said ultrasonic signal has a 
main frequency of about 20kHz. 

62. A method according to any of claims 1, 3, 4 or 1 1, wherein said ultrasonic signal has a 
30 main frequency of below 20kHz. 

63. A method of performing a transaction over an Internet, comprising: 
transmitting information encoding acoustic waves over the Internet from a client 

computer to a server computer; 
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analyzing said information at said server computer, and 

performing a transaction at said server computer responsive to said analysis. 

64. A method according to claim 63, co m p ri sing inputting said acoustic waves to said 
5 client computer using a microphone of said client computer. 

65. A method according to claim 63 or claim 64, wherein said transaction comprises a 
financial transaction. . . . . . \ _^ij f- - 

10 66. A method according to any of claims 63-35, wherein said information comprises 
authentication information. 

67. A method according to any of claims 63-66, wherein said waves comprise ultrasonic 
CH waves. 



a 



15 



68. A method of creating a smart card t erminal t cfrniprfgingT 

providing a general purpose computer having a general-purpose sound sub -system; and 
ty ' loading a smart-card terminal software on said computer, 

^~ wherein said software controls said sound system to receive acoustic waves from a 

□ 20 smart card. 

w • 
a 

Id 69. A method according to claim 68, wherein said software analyses said received acoustic 

waves to determine information encoded by said acoustic waves. 

25 70. A method according to claim 68, wherein said software retransmits said acoustic waves 
to a remote computer which analyses said received acoustic waves to determine information 
encoded by said acoustic waves. 

71 . A method according to any of claims 68-70, wherein loading a smart-card terminal 
30 software comprises downloading the software over an Internet. 

72. A method according to any of claims 68-7 1, wherein said acoustic waves comprise 
ultrasonic waves. 
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73. A smart card comprising: 
a memory; 

a processor, and 

an ultrasonic transmitter which transmits signals generated by said processor 
5 responsive to information stored in said memory, wherein said signals have a main frequency 
of under 30kHz. 

74. . — ^ smart card according to claim 73, comprising a receiver which receives ultrasonic 
signals, wherein said processor processes said received signals and stores information in said 

10 memory responsive to said processing. 

75. A smart card according to claim 73 or claim 74, wherein at least one of said 
transmission and reception are encrypted using a public-key encryption scheme* 

15 76. A computer system comprises: 
a processor; 

a sound sub-s} , stem, designed for generating music, comprising: 
a speaker which generates acoustic waves; and 
a microphone which receives acoustic waves; 
20 a memory; and 

a software installed in said memory, wherein said software analyses acoustic waves 
received by said microphone to recognize information encoded by said acoustic waves and 
wherein said software uses said speaker to transmit information encoding acoustic waves 
responsive to said recognized information. 

25 

77. A computer according to claim 76, wherein said acoustic waves comprise ultrasonic 
acoustic waves. 

78. A method of Internet authentication, comprising, 

30 transmitting, over an Internet, authentication information encoded by sound, irom a 

client computer to a server computer; 

analyzing said information at said server computer; and 

tr ansmi tting, over the Internet, an authentication response to said client computer. 



39 



ziuia 



OD * H3XSN3H C8CSTZ6 C 216 XVd 6C:TZ CE3M 66. CO/CO 



4 



100/00809 



25 



79. A method of attaching a peripheral to a computer, comprising: 

providing a general purpose computer including a sound generating and receiving 
subsystem; 

analyzing, at said computer, received sounds to detect acoustic transmissions from said 
5 peripheral; and 

transmitting, form said computer, information to said peripheral using encoded sound 
transmissions. 

80. A method of consumer transactions, comprising: 

10 wireless receiving in a commercial institution, from a remote computer located in the 

commercial institution, a bill; 

authorizing said bill; and 

transmitting said authorization to said remote computer. 

O 15 81. A method according to claim 80, wherein said commercial institution comprises a 
rjj restaurant. 

ru 
«n 

ce 

M 



82. A method according to claim 80 or claim 81, comprising adding an amount to said bill. 



20 83. A method of power transmission to a smart card, comprising: 
UJ transmitting an ultrasonic wave to a smart card; 

. converting said wave to electrical energy at said smart card; 

sl) storing said energy at said smart card; and 

0i 



using said electrically stored energy to power a transmission from said smart card. 

84. A method according to claim 83, wherein said wave is converted using a same 
piezoelectric transducer as used for said transmission. 



40 



CT0® 



OO V HaXSNSd 



cecsTze c ZLe xvd ecuz aatt ee. co/co 



ABSTRACT OF THE INVENTION 
Communication between electronic devices using sonic or ultrasonic waves without 
requiring the installation of dedicated communication hardware in the devices. Preferably, the 
communication uses existing speakers and/or microphones that are usually included in a 
computer installation for generating music for a human user. 
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Appendix A 

VisnalBasic Code for Computer 



Attribute VB_Namc « "main" 
Option Explicit 



'Signal params 
10 Public Const MESTAMP As Integer = 300 

Public Const MinQWidth As Long = 400 ">1 0*(2*2 0)samples per bit 
Public Const periodorg As Long =100 'length in saropJes of two bits = 2* fsamplc/freq 
Public Const ftimeorg As Long = 60 
Public Const rtimeorg As Long = 40 
15 Public Const NSYNC As Integer = 5 •# of [T.'OT repetitions in beginning for sync (5=1 
byte) 

Public Const SigDuratiou As Long — 200 In msec (should be 200 for full visa) 
'used to determine recording time. 
Cf! Public Const MAXRECTEVEDBITS As Long = 1 000 *used only for result array allocation 

20 'Public Const UDBALSTRING As String- ,t W5326100311229999" 
Public Const JDEALSTR1NG As String = "Comsense Ltd, 1234" 

■Public Const FilcName As String = ^\ecoTn\m\data2-wav M 
Public Const FileName As String « "mic" 
25 Public Const MaxFileDataLcngth As Long = 441 00 
Public Type minmaxstruct 
Val As Integer 
loc Ajs Long 
Q End Type 

q 30 Public DataQ As Integer, DataorgQ As Integer, t As Single 



Sub testQ 

Dim maxorg As Integer, minorg As Integer, rtime As Long, ftime As Long, stopbitloc As 
35 Long, crrmsg As String 

Dim resuJtO As Integer, resultdO As Integer, idcalQ As Integer, difPO As Integer, msg As 
String 

RcDhn result(MA?CRECIEVEDBITS) 

ReDim icsultd(MAXRECIEVEDBITS) 
40 Call GetSyncData( stopbitloc, minorg, maxorg, rtime, ftime) 

Call GetData(stopbitloc, minorg, maxorg, rtime, dime, errmsg, result, resuhd) 

ideal - char2bin(IDEALSTRING) 

ditJ «= Compare Vecs(ideal, resnltd) 

graph.MS Chart 1 .ChartData = diff 
45 *msg - bm2char(resultd) 
End Sub 

Sub mainfuncQ 

50 Dim FoundSignal As Boolean, i As Integer, tempo As Integer 

Dim maxorg As Integer, minorg As Integer, rtime As Long, ftime As Long 

A-l 
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Dim stopbitloc As Long, emnsg As String, msg As String 

Dim resultO As Integer, resultdO As Integer, idealO As Integer, difiO As Integer 

f %-int,&-long int,! -single float,#-double 

5 FoundSignal = False 
graph, show 

ReDim resuJt(MAXRECIEVEDBITS) 
RcDim rcsultd(MAXREClEVEDBITS) 
ideal = char2bin(IDEALSTRING) 
10 While FoundSignal ■* False 

Debug.Print" " 

tic 
again: 

Call prcprocess 
15 tocCpreproc") 

FoundSignal « Get_Data_FromJSignal(MINAMP, MinQWidth) 
Call Plot(l, Dataorg, 15) 
Call Plot(2, Data, 15) 
•i^DoEventsO 

20 'toe ("graphs") 

?n 'GoTo again 

'grapluMSChaitl .ChartData = Dataorg 
r graphJVlSOiartzcK3ni.aiartData = Data 
If FoundSignal «* True Then 
*A 25 Call GetSyncData(stopbitloc B minorg, maxorg, rtime, ftiine) 

y FoundSignal ~ GctData(stopbit3oc, minorg, maxorg, rtime, ftimc, crrmsg, result, resultd) 

C\ If FoundSignal - True Then 

diff = ComparcVecsQdcal, resultd) 
« Call Plot(2, Data, 1) 

^ 30 CallPlot(3,djft 1) 

> msg = bin2char(resultd) 
Else 

ReDim diffl[2*i 1 plot triangle forbad stop/start 
difi(l) = l 
35 difi(2)«0 

Call Plot(3, dif^ I) 

graphxounter.Caption = graphucounter. Caption + 1 
End If 
End If 
40 i»DoEventsO 

FoundSignal = False 
Wend 
End Sub 

45 Subticp 

t = Timer 
End Sub 

Sub too(s) 
50 Debug J^rint s; w = Timer -t 
graphAime.Caption = Timer - 1 
t = Timer 
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End Sub 



10 



Attribute VBName = "functions" 
Sub preproccssO 

Dim Fd(2, 3) As Single, Flp(2, 3) As Single 



Call InitFilt(Fd, Flp) 
Call ReadjDataJFromJFilcCPileNanie) 
Call MATLABFiltPasUTd) 
Call DataAbs 
15 Call MATLABFiltFast(Flp) 
•Call MATLABFillFasU^Flp) 
Call SavcdataAsOig 
•graphJvlSChartl.ChartData — Dataorg 
'graph.MSChartzoom.CbartData ~ Data 
gi 20 End Sub 

O 

M Sub Plo<figurenum As Integer, sourceO As Integer, decimate As Integer) 

fij Dim tempO As Integer, i As Long, j As Long 

f U ReDira temp(lnt(UBoimd(sourcc) / decimate)) 

Ql 25 For i = 1 To UBound(tcmp) 

temp® — source(t * decimate) 
\\ Next 
s If figurenum = 1 Then 

O graph.MSOiflrtl.ChartI>ata = temp 

30 Elself figurenum » 2 Then 
p graphJv!Saiart2.ChaitI>ata = temp 

iji Elself figurenum = 3 Then 

~* graph^SOiartsoom.ChartData = temp 

End If 
35 End Sub 

Sub MATLABFilt(Filt) 

Dim tempo As Integer, FfltLength 
Dim i, j As Integer 

40 FiltLengtb = UBound(FIlt) + 1 
ReDim temp(Datal^ngth) 
For i = l To DalaLenglh 
temp® »Filt(2. 1) * Data® 
For j = 2 To FiltLength 
45 If Q <- i) Then 

temp® = temp® + Filt^j) * Data(i + 1 - j) 
temp® - temp® - Filt(l f j) • tcmpC + 1 - j) 
End If 
Nextj 
50 Nexti 

For i = 1 To DataLength 
Data(i) « temp® 
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Nexti 
End Sub 

Sub MATLABFtltF astCFilt) 
Dim tempO As Integer 
Dim i As Long, L As Long 

L = UBound(Data) 
ReDim tcmp(L) 
For i = 3 To L 

temp® - (Filt(2, 1) * Data(i) + Filt^, 2) * Data(i - \ ) + Filt(2, 3) * Data(i - 2) - Fitt(l, 2) 
* temp(i - 1) - Filt(l, 3) * iemp(i - 2)) 
Nexti 

For i = 1 To L 

Data(i) = temp(i) 'CSng(temp(i)) / 1.5 
Nexti 
End Sub 
Sub DataAbsO 
Dim i As Long 

For i — 1 To UBoundQData) 

Data© = Abs(Data(i)) 
Next 
End Sub 

Function Read_DataJFrom - Filc(FileName) 
Dim fin 

Dim i As Long, nsamples As Long 

If StrComp(FileName, "MIC") = 1 Then 'read fromnric 1 
nsamples = RccordSampleRate * RccordTime / 1000 * 2 'for two mics 
ReDim Data(nsamples * 2) in bytes 

Call DoToneTobuff(Action, RecordSampleRate, Playfrcq, PlayTime, Speaker, „ 
Delay, RecordSampleRate, MOR^cordTime), Data(l)» _ 
nsamples* 2- 1) 
For i = 1 To Int(nsamples / 2) 

Data(i)=Data(i*2) 
Next 

40 ReDim Preserve Dala(Int(nsamples / 2)) 
Else 'Reading from File 
nsamples = MaxFilsDalaLength 
ReDim Data (nsamples) 
fin - FreeFilcO 
45 Open FUeName For Binary As fin 
Get fin, 101, Data 
Close fin 
End If 

50 End Function 

Sob SavedataAsOrgO 
Dim i As Long 
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RcDim Dataorg(UBound(Data)) 
For i = 1 To UBouxd(Data) 

Dataorg(i) = Data(i) 
Next 
5 End Sub 

Sub InitFilt(FdO As Single, FlpO As Single) 
Fd(l, 1) = 1# 

... . -Fd(l, 2) -1.6743 

10 Fd(l, 3) = 0.7483 

Fd(2, 1) = 0.1259/ 1.5 
Fd(2,2)-0#/1.5 
Fd(2, 3) = -0.1259/ 1.5 

15 

Flp(l, 1)=1# 
Flp(l, 2) «- 1.7991 
Flp(l f 3) = 0.8175 

Ui 20 Flp(2, 1) = 0.0046 

f 3 Flp(2, 2) = 0.0092 

U Fip(2, 3) = 0.0046 

rjj End Sub 

ru 

m 25 

Attribute VBJName *- "iunctiaiis2 M 

Function <3etData(sto pbitloc As Long, minorg As Integer, maxorg As Integer, rtime As Long, 
30 fhme As Long, _ 
q crrmsg As String, resultO As Integer, resultdO As Integer) As Boolean 

Dim i As Long, j As Long, temp As Integer, sterthigh As Integer, stoplow As Integer 
Dim goodsig As Boolean, endreached As Boolean* ires As Long 
H Dim min As Integer, max As Integer, high As Integer, low As Integer, radius As Long 

™ 35 Const a As Single - 0.8 

temp = UBound(rcsultd) nmtn 
goodsig = True 
endreached = False 
max = maxorg 
40 -mfn = minorg 

i = stopbitloc - 10 
radius = 5 

ires = 1 'results army index 
While goodsig ■» True And endreached ■» False 
45 Ifi> 3500 Then 

i — i 
End If 

If (i + 10.5 * (rtime + fflme)) > UBoimd(Data) Then 
50 endreached ■= True 

Else 

'find next bit starting position **n^ levels 
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miii = min*a-h(l-a)* FmdMinMax(i - ftime * 0.2, rtime * 1 ,2, 0).Val 
max = max * a + (1 - a) * FindMmMax(i - ftime * 0.2, rtime * 1.2, l).Val 
high^(max+mm)/2 + (max-mm)/2#*0.1 '%%% 
low = (max + rain) / 2 - (max - rain) / 2# * 0. 1 '%%% 
5 starthigh = (max + mm) / 2 

stoplow = (m£{ + min) / 2 
j = i '+ rtime * 0.2 
temp — DataQ) 

WhUetenm<(mg^ + low)/2#ABdj<i+rtime'*0.a^ . „ 

10 j - j + 1 

temp = DataQ) 
Wend 

i - j + rtimc * 0.5 - 10 ■%%% 
'now we are at the location of the start bit 
15 'check start bit 

temp = gctpoint(Dala, i, radius) 
If temp < starthigh Then 
goodsig — False 

crrmsg = "bad start bit at" , +mmi25tr(j) 
fri 20 Else 
« For j = 1 To 8 

H If (j -Intfl 12) * 2) = 1 Then'j is odd 

^Ti i = i + ftime 

Else 



it 

Ua 25 i = i + rtime 'even 1 



5 End If 

P, If UBoundOData) < i Then 

" 4 goodsig 05 False 

* aa errmsg = "end of signal reached in the middle of byte" 

H 30 Else 



result(ires) = getpoint(Data, i. radios) 
If result(ires) >= high Then 
IU resultd(ires) « 1 

*S Elself resultdOres) <- low Then 

35 resultd(ires) - 0 

Else 

resultd(ire$) — 5 
End If 
ires «= ires + 1 
40 End If 

Nextj 

'check stop bit 
i « i + ftime 

temp = getpoint(Data, i, radios) 
45 If temp > stoplow Then 

goodsig « False 

errmsg = "bad stop bit at location w l +num2str<j) 
End If 
End If 

50 End If 

Wend 

If goodsig = False Then 
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goodsig = False 
Else 

ReDim Preserve resultd(ires - 1) 
ReDim Preserve result(iTes - 1) 
5 End If 

graph.cmnsg.Text = errmsg 
GctData — goodsig 
End Function 

Function getpoint(Data0 As Integer, i As Long, radius As Long) As Integer 
10 Dim sum As Single, j As Long 

'do average . . : t i 

*sum = 0 ' • 

'For j = i - radius To i + radius 
• sum = sum + Data(j) 
15 TSText 

•getpoint = sum / (2 * radius + 1) 
'or without average 
getpoint = Data(i) 
End Function 

50 20 

ul Function Comp areVe<^s(ideal() As Integer) receivedO As Integer) 

I * Dim i As Long, tempo As Integer, crrstr As String 

Dim li As Long, lr ,\s Long, L As Long 
Hi lr~ UBound(received) 

^ 25 li = UBound(ideal) 
M L-li 
M IflroHThen 

errstr = "ERROR IN COMPARISON: BAD LENGTHS" 
C3 If lr>liThen 

W 30 errstr = errstr + M Received " + Str(lr - li) + " more bits" 

a L-K 
U Else 

-£) errstr — crrstr + StrOi - far) 4- "bits are missing" 

£ L-lr 
35 End If 

graph.eizmsg.Text b errstr 
ReDim temp(L) 
Fori-lToL 

temp(i) - idcal(i) - received(i) 
40 Next 
End If 

Compare Vecs = temp 
End Function 

45 Function GetJData_Frcrn_Signal(MINAMP As Integer, MinQWidth As Long) 
Dim i As Long, istart As Long, iend As Long 

Dim QuietPeriod As integer, FoundQuiet As Boolean, FoundSignal As Boolean 
Dim tempo -As Integer, MARGIN As Integer 

50 BEGINMARGIN - 20 
ENDMARGINf = 1 00 
FoundQuiet » False 
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FoundSignal = False 
QuietPeriod = 0 
i«i 

While i <- TJBound(Data> 1) And FoundQuiet = False 'wait for quiet period 
If (Data(i) < MIN AMP) Then 

QuictPeriod = QuietPeriod + 1 
Else 

QuictPeriod — 0 
Endlf 
i = i+l 

If QuietPeriod >- MinQWidlh Then 

FoundQuiet — True 
End If 
Wend 

If FoundQuiet = True Then Vait for Signal 
While i <= UBound(Data, 1) And FoundSignal = False 
If (Data® > JVttNTAMP) Then 
istart = i - BEGINMARGIN 
FoundSignal — True 
Endlf 
i«i+l 
Wend 
Endlf 

If FoundSignal = True Then •wait for 2nd quiet period 
QuietPeriod — 0 
FoundQuiet " False 

While i <= UBovnd(Data, 1) And FoundQuiet «« False 
If (Data(i) <MDSTAMP) Then 

QuietPeriod = QuietPeriod + 1 
Else 

QuietPeriod = 0 
Endlf 
i = i+l 

If QuietPeriod >= MinQWidth Then 

FoundQuiet - True 
Endlf 
Wend 

If FoundQuiet = True And (i - istart) > _ 

(RecordSampleRate / 1000 * SigDuration) Then *wc found a signal 
iend - i - MinQWidth + ENDMARGIN 
ReDim temp(icad - istart + 1) 

For i = istart To iend 'copy the file data to new array 

temp(i - istart + 1) ~ Data® 
Next 

'copy back to Data array 
ReDim Data(icnd - istart + 1) 
For i * 1 To UBound(temp) 

Dala(i) - temp(i) 
Next 

FoundSignal — True 
Else 

FoundSignal = False 
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End If 
End If 

Get_Data_From_Signal = Found Signal 
End Function 

5 

Function GetSyucData(stopbitloc As Long, minorg As Integer, maxorg As Integer, rtimc As 
Long, ftune As Long) 

* returns high and low average values and xisetime,falltime in # of bits- 
Dim max(NSYNQ As Long, min(NSYNC) As Long, i As Integer, xninmax As minmaxstruct 
10 Dim Maxloc(NSYNC) As Long. Minloc<NSYNQ As Long, itimearrfNSYNC - 1) As Long, 
Aimearr(NS YNC) As Long 
Dim temp As Integer 
Fori - 1 ToNSYNC'5 
'find max 

15 minmax = FindMinMax(l + (i - 1) * periodorg, periodorg, 1) 
max(i) « minmax. Val 
Maxloc(i) = minmax Joe 

minmax - FindMinMax(l + (i - 1) * periodorg -f ftimcorg, periodorg, 0) 
_ % min(i) =* minmax. Val 

20 Minloc(i) = minmax.loc 
U Next 

*jf minorg avcrage(min) 

maxorg =* average(max) 

If* 25 

tO For i = 1 To NSYNC 

Si ftimeair(i) = Minloc© - Maxloc(i) 

Next 

Q Fori - 1 To NSYNC - 1 

I'j 30 rthncarr(i) = MaxlocQ + 1) - Minloc® 

O Next 



U 



tone -= average(ftimeaif) 
rtime = average(rtimearr) 
35 stopbitloc = Minloc(NSYNQ 

End Function 

Function average(xO As Long) As Long 
40 Dim i As Long, temp As Long 
temp = 0 

For i = 1 To UBound(x) 

temp •= temp + x(i) 
Next 

45 temp = temp / UBound(x) 
average *= temp 
End Function 



50 Function FmdMinMax(istart As Long, deltai As Integer, MinORMax As Byte) As 
minmaxstruct 

'finds ijun(0)/max(l) in Data from point istart with dellai samples 
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Dim i As Long, teraploc As Long, tempval As Integer 
tempval = Datafistart) 
For i = istart To istazt + deltai 
If MinORMax ^ I And tempval < Data(i) Then TvlAX 
5 tempval = Data(i) 

temploc w i 
End If 

If MinORMax = 0 And tempval > Data(i) Then MIN 
tempval = Data(i) 
10 temploc = i 

End If 

Nexti 

FindMinMax. Val = tempval 
FindMinMax. loc = temploc 
15 End Function 

Function char2bin(s As String) 'converts ascii values to binary vector msb to lsb 
Dim i As Long, j As Integer 
Dim resultO As Integer, temp As Integer 
ReDimresult(Len(s) * 8) 
20 Fori = l ToLen(s) 

temp « Asc(Mid(s f i, 1)) 
For j = 8 To 1 Step -1 
result((i- 1) * 8+j) = temp-Int(teinp/2) * 2 
temp = Int(tennp / 2) 
25 Next 
Next 

char2bin = result 



L End Function 

j*» 30 Function bin2charCBinary As Integer) As String 
'converts binary data to Chars 

Dim Counterl As Long, Counter2 As Integer, Connler3 As Integer 
Dim CanvertorO As Integer, tcmpO As Integer 

35 ReDimtemp(Iat(Len(Binary)/8)) 
ReDtm Convertor(Lcn(Binary)) 
Countex3 = 1 

For Counterl = 1 To 3 * Int(Len(BmaTy) / 8) Step 8 
For Countcr2 = Counterl To Counterl + 7 
40 Convertor(Counter2) « Val(Mid$(Binary, Counter2, 1)) 

NextCounter2 

temp(Counter3) - Convertor(Coxinterl) * 128 + Convertor(Counlerl + 1) * 64 + 
Convertor(Counterl + 2) * 32 4- Convertor(Counterl + 3) * 16 + _ 
Owivertor(&yunterl + 4) * 8 + Convertor(Comiterl + 5)*4 + _ 
4 5 Convertor(Counterl + 6) * 2 + Convertoi(Counterl + 7) * 1 " 

bin2char = bin2char + Chr$(temp(Counter3)) 
Counter3 — Connter3 + 1 
Next Counterl 
End Function 

50 
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Appendix B 

TESTFRM.PAS 
unit testfhn; 

interface . ■ • » i „. ~= ■ * * 

uses 

Windows, Messages, SysUlils, Classes, Graphics, Controls, Forms, Dialogs, 
15 StdCtrls{, toncfcm2}; 

type 

Tfonn2 = class(TForm) 
Button 1: TButton; 
CO 20 Button2: TButton; 
£3 times: TEdit; 

H LabellrTLabel; 
?U Button3 : TButton; 

r!J TimesDone: TEdit; 

£fi 25 RsmTimes: TLabeU 
m Debug: TEdit 

Si Label2: TLabel; 

b procedure Button lClick(Sendcr: TObjcct); 

C3 procedure Button2CHck(Senden TObject); 

I J 30 procedure Button3Click(Scnden TObjcct); 
□ private 
y { Private declarations } 

public 

% r x { Public declarations } 

35 

var 

form Tfonn2; 

procedure DoToncToFU^ActionJlaySampIeRate^layFreq, PlayTime, PlayStdcs, DelayTime, 
40 Records ampleRate, RccordTime:longint; fiirpchar); stdcall; 

external TONE4SIN.DLL t index 1; 
function DoToneTobulI(Acuon^la^ PlayTime. PlaySides, DelayTime, 

RccordSampleRate, RecordTimerJongjnt; bufFcnpointex; 
BufferSi2e:longint):longint; stdcall; 
45 external TONE4SIN JDLL* index 2; 

implementation 

{$R * JDFM} 

50 

procedure Tform2JButtonl Click(Sender: TObjcct); 
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begin 

Button 1 . enabled := false; 

DoToneTofile(3,44000,500 > 3000,3,000.44000,5000, , testl.wav , ); 
Button 1 . enabled :— true; 
5 end; 

procedure Tfonn23utton2Click(SendeT: TObject); 
var 

BL,BR,BL1 ,BR1 rpchar, 
10 f;£2:file; 
- ^ * 3:array[1..44] of char, 
sz,i:longint; 

type 

15 pword = A Word; 
begin 
GetMem(BI^200000); 
Button2.enablcd := false; 
{ StartRec^rd(44100,lOOO);> 
20 sz :<= DoToneTobufnp^lOO^OO^OO^.O^lOO^lOOO^WOOOOO); 

{ StopRecocd;} 

{ sz r-DoToneTobufa:3,44CH)0^00,103,l»44000^3U200000);} 
{ sz ^DoToncTobufI(3,44000,500 p 500,3,O f 44000,l 0O0,BL> 200000);} 
!>j B utton2 .enabled := true; 

(jf 25 system .assign(f2 > *te&tl .wavO; 
^ reset(f2,l); 
*~ blockread(f2>s^izeof(s)); 
^ system.closc(f2); 
5 system.assigri(Ctest2.waV); 
P 30 systemjewrite(f; 1); 
UJ { fillcbar(s^i2eofl[s),0);} 

O blockwriteCtSjSizeofCs)); 
U BL1 :=BL; 

BR1 — BR; 
35 for i r= 1 to sz div 2 do begin 
blodcwriteCtpwoidCBLl^); 
{ bloclcvmt^pwon^BRiy^^);} 

inc(bll^); 
{ inc(brl,2);} 
40 end; 

system,close(f); 
freemem(BI^200000); 



45 procedure Tfonn2^uttan3Click(Sender: TObject); 
var 

BL,BR3L13Rl:pchar; 
£f2:f)le; 

s:array[1..44] of char; 
50 t,c,sz,nlongint; 

type 
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pword — A Word; 
begin 

GetMem(BL^0OO0O); 
Button3 .enabled := false; 

5 {function DoToneTobufT(Action I ^IaySaxtipIeRate^layFreq, PlayTimc, PlaySides, 
DelayTimc, 

Records amplcRate, R^cordTimerlongint; bufferrpointer; 
BufiferSize:longint):longint; stdcall;} 

10 t :~ StrToInt(Times.text); 
{ SlartRecord(44100,100);} 
for i 1 to t do begin 
TimesDone.text :« 'A '+IntToStr<i); 

sz :=DoToneTobuff(3,44100,500,l00 t 3.0,44100,100 > BL > 20000a)- 
15 TimesDone.text :=• 'B M-IntToStr(i); 
TimesDonaUpdate; 
end; 

{ StopRccord;} 

Button3 .enabled := true; 
IH 20 freemein(BI^200000); 
□ end; 

ftj end. 
«i \ 

en 25 



TestDlLdof 



[Compiler] 
A«*0 
B=0 
CM) 
35 D=l 
E=0 
F=0 
G-l 
H=l 
40 1=1 

J=l 

K-0 

L=l 

M=0 
45 N=l 

0=0 

P-l 

Q-l 

R=l 
50 S=0 

T=0 

U=0 
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ru 

m 



h 

•ear 



10 



15 



20 



25 



30 



V=0 
W=0 
X~l 

Y=0 
Z=l 

ShowHints=0 
ShowWaraings=0 
UnitAUases-WinTjpc^Wii^ 
Errs^BDE; 

[Linker] ;4 

MapFile=0 

OutputObjs«0 

ConsoleApp=l 

DebugInfo=K) 

RemoteSymbols=0 

MinStackSize»16384 

MaxStackSizfiF=1048576 

ImageBasc=4194304 

ExcDescriptionF= 

[Directories] 

OutpulDir= 

UnitOutprttDir= 

Pac^geDIXOu^putl)!!-" 

PackageDCPOu^pxitDii^ 

SearchPatb= 

Package3=VCl>40;VCL^^ 
B40;TEE40pSS40;ftevnl4^^ 
Conditionals 3 
DebiigSourceEJiis^ 



[Parameters] 
35 RunParams^ 

HostApplication— 

[Version Info] 

XncludeVer3iQfo==0 
40 AutoIncBuild=0 

MajorVcr=l 

MrnorVer-0 

Rclcase=0 

Build=0 
45 Debug=0 

PreRelcasc-0 

Special^) 

Private=0 

DLL=0 
50 Localc=1037 

CodePage=1255 
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Appendix C 



Assembly Code for Microcontroller 



.*************** sending program ******************* 



10 



15 



; The format is as follows: 

1) T is frequency transmitting, 'CycNum' limes. 

2) '0* is a quiet period, 'CycNum* times. 

3) the data is arranged in ascii format (8 bits), in a "retlw Value™ format ("Codes" routine). 

4) each ascii value is preceded by a 1 1' and is ended by '0' (Sync). 

5) start of transmission is: W. 

; visa4- 50, 44 cycles per bit 20Khz, 22.727Khz 



P 

ru 
ru 

M 



20 



35 



LIST P=12C509 
list R=DEC 

INCLUDE <regS09.inO 



^register data. 





Global Declarations 


25 CycNuml 




EQU 


D'25**l 


CycNumO 




EQU 


D'23**! 


Tx 


EQU 


GP1 




30 Acc 


EQU 


7 




Accl 


EQU 


8 




Codel 


EQU 


0x10 




BitCount 


EQU 


0x11 




CycCount 


EQU 


0x12 





************* ********* 



^firequency transmitting cycles per bit. 



40 



nops: 



macro 

nop 

nop 

nop 

nop 

endm 



45 



50 



Reset: 



CLRF GPIO 
MOVLW 
TRIS GPIO 
CLRF GPIO 



B'OOOOllOO' 
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movlwB'llOlllli' 
option 

goto Start 



;according to the index Codel (>=0) the routine outputs a value in the H df 1 table. 
;data is transmitted from right to left in the "di" string. 
10 Uength is 7 cycles. 



Codes: 



org 0x10 



ru 



s 



r x 



movlw 0x1 2 ;base address. 

15 addwf CodcI,W 

movwfPCL 

;dt ' T 999922113001623SWU ,, 

;dt "901234abcde$$%% AA . n 

dt "4321 .dtL csnesmoC" ^Comsensc Ltd. 1234" 

20 



;each internal loop is 50 cycles long (20.000KHz)> on exit there are 16 spare cycles* 
25 Sendl: 



Sendl L: 



movlw CycNuml 
movwf CycCounl 



bsf GPIO,Tx 
30 nop 

movlw 6 

call WaitW $2 cycles, 

bef GPIO,Tx 
deefsz CycCoimtJF 
35 goto Sendl_Ll 

rctlw 0 

Sendl JL1; 

nop 
nop 

40 movlw 4 

call WaitW ;16 cycles, 

goto Sendl JL 



45 ;cach internal loop is 44 cycles long (22.727KHz), on exit there are 13 spare cycles. 
SendO: 

movlw CycNumO 
movwf CycCoimt 

50 SendO L: 

bsf GPIO,Tx 
nop 
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SendO LI: 



movlw 5 
call WaitW 
bcf GPIO.Tx 
dccfaz CycCount,F 
goto SendOJLl 
retlw 0 

nop 
nop 

movlw 3 

call WaitW 

goto SendOJL 



;19 cycles. 



;13 cycles. 



tn 

p 

hi 

ru 
tn 

m 



o 

w 



\$ ; delay routine: Cycles = 4 + 3*W (1=>7, 2=>10, 3->13, 4~>16, 5=>19, 6=>22) 
WaitW: 

movwf Accl 

WaitWcycJL: 
20 deefsz Accl,F 

goto WaitWcycJL 
retlw O 



25 



30 



35 



Start: 



call Sendl 

nop 

nop 

movlw 3 

call WaitW 

call SendO 

movlw 3 

call WaitW 

goto Start 



;13 cycles. 



40 SendJDigit: 



45 movwf Acc 
movlw 8 



Send Bit: 



movlw iyi& 
movwf Codel 

call Sendl ;start bit is always '1'. 

nop 

nop 

call Codes ^return in V the next digit. 7 cycles. 



movwfBitCount 



rlf ACC.F ;send from MSB to LSB. 

50 btfes STATU5,C 

goto SendJBitO 
nop "~ 
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5 



15 



ru 

m 25 



40 



50 



Send BitO: 



call Sendl 

nops 

nop 

nop 

nop 

goto Send_Bit_L 

call SendO 
nops 



10 nop 
nop 

Send Bit L: 



deefsz BitCount^F 
goto Scnd_Bit 

nops 
nop 

call SendO ;stop bit is always *0\ 



nop 

20 nop 



movlw 2 

call WaitW ;10 cycles, 

deefsz CodeI,F 
goto Send_Digit 



= movlw 1 ;5 

C3 movwfAcc 
ill 30 debug2: 

Q movlw D'128' 

Lu movwf Codel 

sQ dcbngl: 

if] movlw D*255' 

35 call WaitW 

deefsz CodelJF 
goto debugl 
decfez AccJ 7 
goto debug2 



goto Start 



45 nops 
nop 
nop 

END 
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^3 

SI 



=~ 30 



35 



; Define file for PIC1 2C5XX 

ScratchPadRam EQU 0x07 

5 ;FSRs 

INDF EQU 0 

TMRO EQU 1 

PCL EQU 2 

STATUS EQU 3 

10 FSR EQU 4 

OSCAL EQU 5 

GPIO EQU 6 

; Status Bits 

15 C EQU 0 

DC EQU 1 

2 EQU 2 

FD EQU 3 

TO EQU 4 

20 PA0 EQU 5 

GPWF EQU 7 

«, iVO 

n 4 GPO EQU 0 

£ 25 GP1 EQU 1 



GP2 EQU 2 

GP3 EQU 3 

GP4 EQU 4 

GP5 EQU 5 



H F EQU 1 

W EQU 0 
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